Ava’s Final Project Report

Code

# Suppress all warnings
import warnings
warnings.simplefilter("ignore")
import warnings
from statsmodels.tools.sm_exceptions import ConvergenceWarning
warnings.simplefilter('ignore', ConvergenceWarning)

# Importing packages
import pandas as pd
import numpy as np
import datetime as dt
import matplotlib.pyplot as plt
import seaborn as sns
import statsmodels.api as sm
import holidays
import xgboost as xgb
import keras 
import itertools

from pandas.plotting import autocorrelation_plot, lag_plot

from statsmodels.graphics.tsaplots import plot_acf, plot_pacf
from statsmodels.tsa.arima.model import ARIMA
from statsmodels.tsa.stattools import adfuller
from statsmodels.tsa.statespace.sarimax import SARIMAX
from statsmodels.tsa.stattools import adfuller
from statsmodels.tools.eval_measures import rmse

from pmdarima.arima import auto_arima

from scipy.stats import zscore

from sklearn.metrics import mean_squared_error, mean_absolute_error, r2_score
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split, TimeSeriesSplit, RandomizedSearchCV, GridSearchCV, cross_val_score
from sklearn.feature_selection import SelectFromModel
from sklearn.decomposition import PCA

import prophet
from prophet import Prophet
from prophet.diagnostics import cross_validation, performance_metrics
from prophet.make_holidays import make_holidays_df

from xgboost import plot_importance, plot_tree, XGBRegressor

from keras.layers import LSTM, Dense, Dropout, Input, Bidirectional, BatchNormalization
from keras.models import Model, Sequential
from keras.callbacks import EarlyStopping, LearningRateScheduler, ModelCheckpoint
from keras.regularizers import l1_l2
from keras.optimizers import Adam

from math import sqrt

plt.style.use('fivethirtyeight')

# Loading data
df = pd.read_csv('initial_data2.csv')

# Converting Date column to Datetime object
df['Date'] = pd.to_datetime(df['Date'])

1 Ava’s Time Series Vaccine Rate Prediction Project Final Report

1.1 I. Abstract

The objective of this project is to use various time-series modeling techniques to predict the percentage of the United States’ states and territories whose citizens have received their first booster COVID-19 vaccination dosage. I conducted extensive exploratory data analysis to uncover insights on the data such as variable distributions and feature interactions before performing data cleaning by changing data frequency, imputing null values, and adding engineered features among other processes. Next, six models, ARIMA, auto ARIMA, univariate Prophet, multivariate Prophet, XGBoost, and Keras LSTM are developed, trained, and tuned on the vaccination data. Notably, many of the models suffered from overfitting and other issues due to the cumulative nature of the dataset and the size of it. The manually trained ARIMA model emerged as the best-performing model as indicated by the lowest root mean squared error (RMSE) as it was able to approach the modeling process with simplicity and handle seasonal components. However, this model also had unusual results in the train RMSE being greater than that of the test set. Some other findings were that the vaccination rate of specific age groups and of specific manufacturers are imperative in predicting overall vaccination rates. As for the working dynamics, during our project, our team effectively divided work and utilized each other’s strengths, meeting both in person and over Zoom for complex tasks like debugging. This experience taught me the importance of strategic division of responsibilities and leveraging individual strengths for efficient collaboration.

1.2 II. Project and Data Overview

1.2.1 A. Project Overview

Using a CDC database of weekly-reported vaccine equity data at a United States state level, we seek to predict the percent of people in a county who have completed a primary series of the COVID-19 vaccination and received a booster dose. This data will be cleaned and organized for use in a time series prediction model. Some of the predictors for this project include age group vaccination rates, specific manufacturere vaccination rate, and location. Users of the model may include vaccine manufacturers who are seeking data on specific geographical places or demographics that they should target their advertisement towards. For example, should our analysis reveal that high vaccination rates among children under 12 strongly correlate with overall vaccination coverage, manufacturers might be influenced to focus their marketing efforts on families. Additionally, stakeholders can gain an understanding of the impact certain features have on locations reaching near 100% booster vaccination completion or when this might occur.

1.2.2 B. Data Overview and Preprocessing

1.2.2.1 1. Data Collection:

We are using data collected by the Centers for Disease Control and Prevention (CDC). These data are made accessible through the CDC’s Application Programming Interface (API).

1.2.2.2 2. Data Cleaning:

Imputing missing values and removing redundant features

Our goal for this project is to predict the percentage of the population that has received the initial booster. With this objective in mind, we identified missing data, deleted redundant columns, and investigated outliers. We eliminated COVID-19 vaccination features with more than 1,000 missing values, as they relate to the bivalent booster or second booster distribution. The second booster was introduced about a year after the initial booster. To avoid data leakage, we ensured that data regarding the second booster doses are absent, given that these vaccines weren’t available at the commencement of our dataset.

There were columns representing both the proportion of vaccinated people in a state and the actual number of people who received the vaccine. Since these essentially measured the same metric, albeit at different scales, we felt it redundant. Hence, we discarded the count features and retained the proportion columns, ensuring consistent scaling across states.

Furthermore, a significant portion of data before November 2nd, 2021, was missing. Research revealed that this date aligned with the CDC’s recommendation for children aged five to eleven to receive the vaccine (Kates et al., 2021). This led us to adjust our dataset’s starting point to this date for consistency. We observed a significant number of missing entries for December 14th, 2022. While the cause remains unclear, our research into time series imputation techniques led us to select the Last Observation Carried Forward (LOCF) method (Abulkhair, 2023). Consequently, we used the data from December 7th, 2022, to fill the gaps for those states with incomplete data on December 14th, 2022.

Code

# Find NaN value counts
missing_counts = df.isna().sum()

# Sort the missing value counts in descending order
missing_counts_sorted = missing_counts.sort_values(ascending=False)

# columns with over 1000 missing values
columns_with_over_1000_missing = missing_counts_sorted[missing_counts_sorted > 1000].index

# remove columns with over 1000 missing
df = df.drop(columns=columns_with_over_1000_missing)

# list of numerical columns wihh equivalent percentage columns to drop
columns_to_drop = [
       'Administered_Dose1_Recip',   
       'Administered_Dose1_Recip_5Plus',
       'Administered_Dose1_Recip_12Plus',  
       'Administered_Dose1_Recip_18Plus',
       'Administered_Dose1_Recip_65Plus', 
        'Series_Complete_Yes',
        'Series_Complete_5Plus',
        'Series_Complete_12Plus',
        'Series_Complete_18Plus',
       'Series_Complete_65Plus',
       'Additional_Doses_18Plus', 
       'Additional_Doses_50Plus', 
       'Additional_Doses_65Plus']

# Dropping the columns from the df
df = df.drop(columns = columns_to_drop)

# Defining response variable for easier 
pred_var = 'Additional_Doses_Vax_Pct' 

given_date = pd.to_datetime('2021-11-02') 

df = df[df['Date'] > given_date]

specific_day = '2022-12-14'  

specific_day_data = df.loc[df['Date'] == specific_day]

rows_with_missing_values = specific_day_data[specific_day_data.isnull().any(axis=1)]

location_values = rows_with_missing_values['Location'].tolist()

# Month column
df['month'] = df['Date'].dt.month

# Year column
df['year'] = df['Date'].dt.year

# Filter the DataFrame for dates in December 2022
december_2022_data = df[(df['year'] == 2022) & (df['month'] == 12)]

for location in location_values:
    # Subset data for the specific location
    location_data = df[df['Location'] == location]
    
    # Subset data for the specific dates
    dates_to_impute = location_data[location_data['Date'].isin(['2022-12-07', '2022-12-14'])]
    
    # Perform forward fill (LOCF) imputation for the specific location and dates
    imputed_data = dates_to_impute.bfill()
    
    # Update the original DataFrame with the imputed data for the current location
    df.loc[imputed_data.index, imputed_data.columns] = imputed_data

1.2.2.3 3. Temporal Aggregation:

Upon conducting a deeper analysis of the data, we discovered a shift in June 2022, where the API transitioned from daily to weekly reporting. To maintain consistency, we chose to resample our dataset to capture weekly observations each Wednesday, aligning with the new reporting pattern established post-June 2022.

Code

june_2022_data = df[(df['year'] == 2022) & (df['month'] == 6)]

dec_2021_data = df[(df['year'] == 2021) & (df['month'] == 12)]

df['day_of_week'] = df['Date'].dt.day_name()

# Identifying day of week
given_date = pd.to_datetime('2022-06-22') 
days = df[df['Date'] > given_date]

df = df[df['day_of_week'] == 'Wednesday']

1.2.2.4 4. Outlier Detection

Segmented Analysis Outlier Detection on Aggregated Data

For outlier detection, we used the average for each feature across observations for each date so that we could make the date the index. We decided to use segmented analysis for outlier detection which breaks the dataset into monthly segments and calculates the interquartile range (IQR) for each segment. This can help identify if outliers are specific to certain months because the rate of vaccination varies greatly month-to-month. Using this technique, we identified one outlier in our dataset which represents the response variable at the end of June 2022. However, I believe this outlier corresponds to the major public health announcement made by the U.S. Food and Drug Administration (FDA) regarding the recommendation to include the Omicron BA.4/5 component for COVID-19 vaccine booster doses and for the general public to obtain a booster dosage (Marks, 2022). Therefore, I believe this relative spike (which appears to be incredibly minimal) correlated with an external event is justified and a representation of the true variability in the data. Removing it, in my eyes, could lead to a loss of information.

Code

avg_vax_pct_per_day = df.groupby('Date')['Additional_Doses_Vax_Pct'].mean().reset_index()
# Convert 'Date' to datetime format
avg_vax_pct_per_day['Date'] = pd.to_datetime(avg_vax_pct_per_day['Date'])

# Create a month-year column for segmentation
avg_vax_pct_per_day['Month_Year'] = avg_vax_pct_per_day['Date'].dt.to_period('M')

# Group by Month_Year and calculate IQR for each month
iqr_values = avg_vax_pct_per_day.groupby('Month_Year')['Additional_Doses_Vax_Pct'].apply(lambda x: (x.quantile(0.25), x.quantile(0.75))).reset_index()
iqr_values.columns = ['Month_Year', 'IQR_Values']
iqr_values['Q1'] = iqr_values['IQR_Values'].apply(lambda x: x[0])
iqr_values['Q3'] = iqr_values['IQR_Values'].apply(lambda x: x[1])
iqr_values['Lower_Bound'] = iqr_values['Q1'] - 1.5 * (iqr_values['Q3'] - iqr_values['Q1'])
iqr_values['Upper_Bound'] = iqr_values['Q3'] + 1.5 * (iqr_values['Q3'] - iqr_values['Q1'])

# Merge the IQR values back to the main dataframe
avg_vax_pct_per_day = pd.merge(avg_vax_pct_per_day, iqr_values, on='Month_Year')

# Determine if a data point is an outlier for its respective month
avg_vax_pct_per_day['is_segmented_outlier'] = (avg_vax_pct_per_day['Additional_Doses_Vax_Pct'] < avg_vax_pct_per_day['Lower_Bound']) | (avg_vax_pct_per_day['Additional_Doses_Vax_Pct'] > avg_vax_pct_per_day['Upper_Bound'])
# Scatter plot to see segmented analysis outliers
plt.figure(figsize=(15, 6))

# Plot non-outliers in blue and outliers in red
plt.scatter(avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == False]['Date'], 
            avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == False]['Additional_Doses_Vax_Pct'], 
            color='blue', s=5, label='Regular Data Point')

plt.scatter(avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == True]['Date'], 
            avg_vax_pct_per_day[avg_vax_pct_per_day['is_segmented_outlier'] == True]['Additional_Doses_Vax_Pct'], 
            color='red', s=5, label='Segmented Outlier')

plt.title('Segmented Outliers Detection in Average Additional Doses Vax Pct per Day')
plt.xlabel('Date')
plt.ylabel('Average Additional Doses Vax Pct')
plt.legend()
plt.grid(True)
plt.tight_layout()
plt.show()

1.2.2.5 5. Feature Engineering:

In our time-series analysis, we recognized the value of feature engineering to uncover potential predictors not explicitly present in the CDC’s API. Consequently, we integrated columns indicating the quarter, month, year, day of the week, day of the month, day of the year, and week of the year in which each observation was taken. Additionally, we established columns denoting the season of the observation (Winter, Spring, Fall, or Summer). Finally, we incorporated a Boolean column to indicate if the week of the observation encompassed a holiday, as per the holidays Python library, and another to denote if it contained a vaccine announcement by the CDC (Montel, 2017; Hahn, n.d.).

To explore time trends in prediction variables over time, we have had to group the data by date. This was necessary as otherwise the data contains multiple entries for each date for each state. To investigate lag we have plotted an ACF graph. The pattern the autocorrelation function (ACF) plot exhibited is commonly observed in time series data with a strong short-term memory or persistence. It implied that the most recent values have a more pronounced impact on the current value, and the impact of earlier values diminishes gradually. The decay in autocorrelation suggests a relatively fast decrease in correlation with increasing time lags. To further investigate the lag we have plotted the partial autocorrelation function (PACF) graph which showed the most significant lag at value of one week. Thus we have created a lag variable with shift of one week. Notably, autoregressive integrated moving average (ARIMA) models intrinsically factor in such dependencies.

Code

# Quarter column
df['quarter'] = df['Date'].dt.quarter

# Day of year column
df['dayofyear'] = df['Date'].dt.dayofyear

# Day of month column
df['dayofmonth'] = df['Date'].dt.day

# Week of year column
df['weekofyear'] = df['Date'].dt.isocalendar().week.astype(np.int64)

# Defining function to identify season
def get_season(date):
    month = date.month
    day = date.day
    if month in [3, 4, 5]:
        season = 'spring'
    elif month in [6, 7, 8]:
        season = 'summer'
    elif month in [9, 10, 11]:
        season = 'fall'
    else:
        season = 'winter'
    

    if month == 3 and day < 20:
        season = 'winter'
    elif month == 6 and day < 21:
        season = 'spring'
    elif month == 9 and day < 22:
        season = 'summer'
    elif month == 12 and day < 21:
        season = 'fall'
    
    return season

# Applying function and creating season column
df['season'] = df['Date'].apply(get_season)

# Create a list of US holidays for the given year range in the dataframe
us_holidays = holidays.US(years=[df['Date'].dt.year.min(), df['Date'].dt.year.max()]).keys()

# Convert us_holidays to a pandas Series of datetime objects
us_holidays_series = pd.Series(pd.to_datetime(list(us_holidays)))

# Create Holiday column
df['holidays'] = df['Date'].isin(us_holidays_series) | (df['Date'] + pd.Timedelta(days=1)).isin(us_holidays_series)
df['holidays'] = df['holidays'].replace({True: 'Holiday', False: 'Normal day'})

# Determine which weeks have a holiday
holiday_weeks = us_holidays_series.dt.strftime('%U-%Y').unique()

# Assign a "holiday season" for every date that's within a week having a holiday
df['holiday_season'] = df['Date'].dt.strftime('%U-%Y').isin(holiday_weeks)

Code

# Define a list of unique announcement dates
announcement_dates = [
    "04/28/2023", "04/27/2023", "04/18/2023", "03/14/2023", "03/10/2023",
    "12/16/2022", "12/08/2022", "10/21/2022", "10/12/2022", "09/13/2022",
    "08/31/2022", "08/26/2022", "08/19/2022", "07/13/2022", "07/08/2022",
    "06/30/2022", "06/17/2022", "05/17/2022", "05/05/2022", "04/29/2022",
    "04/15/2022", "04/01/2022", "03/29/2022", "03/21/2022", "03/11/2022",
    "02/11/2022", "02/01/2022", "01/31/2022", "01/11/2022", "01/07/2022",
    "01/03/2022", "12/17/2021", "12/14/2021", "12/09/2021", "11/30/2021",
    "11/19/2021", "10/29/2021", "10/26/2021", "10/22/2021", "10/20/2021",
    "10/14/2021", "10/01/2021", "09/24/2021", "09/22/2021", "09/20/2021",
    "09/17/2021", "09/10/2021", "09/02/2021", "09/01/2021", "08/24/2021",
    "08/23/2021", "08/18/2021", "08/13/2021", "08/12/2021", "08/06/2021",
    "08/03/2021", "07/30/2021", "07/16/2021", "07/13/2021", "07/08/2021",
    "07/06/2021", "07/02/2021", "06/29/2021", "06/25/2021", "06/15/2021",
    "06/11/2021", "06/10/2021", "05/25/2021", "05/19/2021", "05/11/2021",
    "05/10/2021", "04/27/2021", "04/23/2021", "04/21/2021", "04/16/2021",
    "04/13/2021", "04/12/2021", "04/01/2021", "03/26/2021", "03/24/2021",
    "03/17/2021", "03/05/2021", "03/02/2021", "02/27/2021", "02/26/2021",
    "02/25/2021", "02/23/2021", "02/22/2021", "02/12/2021", "02/05/2021",
    "02/04/2021", "01/29/2021", "01/14/2021", "01/04/2021", "12/28/2020",
    "12/22/2020", "12/21/2020", "12/18/2020", "12/17/2020", "12/14/2020", "12/12/2020"
]

# Convert to datetime and deduplicate
announcement_dates = list(set([pd.to_datetime(date) for date in announcement_dates]))

# Convert announcement dates to week-year format
announcement_weeks = [date.strftime('%U-%Y') for date in announcement_dates]

# Check if the date in the dataset is within the same week of any announcement dates
def in_announcement_week(date):
    return date.strftime('%U-%Y') in announcement_weeks

# Create the 'vax_announcement' column
df['vax_announcement'] = df['Date'].apply(in_announcement_week)

1.2.2.6 6. Exploratory Data Analysis (EDA)

Temporal Visualizations & Seasonal Decomposition

We have used the seasonal and trend decomposition using Loess (STL) to investigate potential trends, seasons and residuals. Based on the STL plot, we have learned that Additional_Doses_Vax_Pct has a very steep increase in the first four to five months after the booster’s initial release, and then the rate tapered and increased at a small and steady rate. This was expected as one might consider that most people who wanted the booster, receved it when it first came out. The seasonal plot provides clear evidence for a seasonal pattern of around three months. This pattern is something we kept in mind and explored further in variable analysis. We will account for this pattern in a variety of ways moving forward with the project. For example one of the solutions we employ is to use an ARIMA model which can account for seasonal components. However, for other models we have creaed a categorical Season variable. Lastly, the residual pattern suggests that the STL may not have adequately captured some underlying patterns or structures in our time series data.

Code

# STL decomposition to investigate trends, seasons and residual

# group data by date as there are multiple entires per each date
time_series_data = df.groupby('Date')[pred_var].mean().reset_index()
# set index to date
time_series_data = time_series_data.set_index('Date')

# Perform STL decomposition with a seasonality period of 7 because data are reported weekly
result = sm.tsa.seasonal_decompose(time_series_data[pred_var], model='stl', period=7)

# Access the decomposed components
trend = result.trend
seasonal = result.seasonal
residual = result.resid

# Plot the original time series, trend, seasonal, and residual components
plt.figure(figsize=(12, 8))

# Plot a subset of data 
plt.subplot(4, 1, 1)
plt.plot(time_series_data[pred_var], label='Original Time Series')
plt.legend()
plt.title('Time Series Over Time')
plt.xlabel('Date')
plt.ylabel(pred_var)


plt.subplot(4, 1, 2)
plt.plot(trend, label='Trend')
plt.legend()
plt.title('Trends in Time Series')
plt.xlabel('Date')
plt.ylabel(pred_var)



plt.subplot(4, 1, 3)
plt.plot(seasonal, label='Seasonal')
plt.legend()
plt.title('Seasonal Trends in Time Series')
plt.xlabel('Date')

plt.subplot(4, 1, 4)
plt.plot(residual, label='Residual')
plt.legend()
plt.title('Residuals in Time Series')
plt.xlabel('Date')

# Customize x-axis labels to rotate by 45 degrees
plt.xticks(rotation=45)

plt.tight_layout()
plt.show()

Correlation Analysis

This ACF pattern is commonly observed in time series data with a strong short-term memory or persistence. It implies that the most recent values have a more pronounced impact on the current value, and the impact of earlier values diminishes gradually. The decay in autocorrelation suggests a relatively fast decrease in correlation with increasing time lags. Autoregressive models are ideal for dealing with this particular autocorrelation pattern. To investigate this further we have looked at the PACF graph and identified the biggest spike at value of one week. To prevent correlation issues in our model I will experiement with adding lag terms such as one week.

Code

# PACF Plot

# Calculate the PACF
pacf = sm.tsa.pacf(time_series_data, nlags=25)

# Create the PACF plot
plt.figure(figsize=(12, 6))
plt.bar(range(len(pacf)), pacf)
plt.xlabel('Lag')
plt.ylabel('Partial Autocorrelation')
plt.title('Partial Autocorrelation Function (PACF)')
plt.grid(True)
plt.show()

Below, I add the one week lag as indicated to do so by the PACF graph. This is the final preprocessing step I took, and I exported the preprocessed dataframe for ease of use across all of my models. Therefore, the dataframe I will use and reference in the model development section and beyond will be 'df_post_eda.csv'.

Code

# Adding one week lag
df['Additional_Doses_Vax_Pct_1_w_lag'] = df['Additional_Doses_Vax_Pct'].shift(1)

1.2.2.7 Univariate Analysis

Distribution of Response Variable

Here, we can see that the response variable is skewed to the left and that the most significant concentration of data lies between the 30% to 50% vaccination rate, suggesting that for many samples, the percentage of additional doses administered falls within this range. It’s worth noting the scarcity of data points both below 10% and above 60%. This indicates that very low and very high vaccination rates are less common among the samples we have.

Code

# Distribution of response variable
sns.histplot(df[pred_var], kde=False )

<Axes: xlabel='Additional_Doses_Vax_Pct', ylabel='Count'>

Distribution of features after data cleaning and imputation

We can see that many of the features are relatively normally distributted with some having an extreme skew.

Code

# Distribution of features after data cleaning and imputation

# find continous/ numerical variables
continuous_vars = df.select_dtypes(include=['float64', 'int64']).columns.tolist()

# plot df
%matplotlib inline
df.hist (column= continuous_vars,figsize= (50,30))
#hides array names that are otherwise printed
_ = plt.plot()

Distribution of feature-engineered season

We can see that there are more observations from the winter. This may have been because of where we start and end out data as a result of vaccine guidelines for 5-11 year olds.

Code

# Distribution of season 
categorical_variable = 'season'

# Create a countplot
plt.figure(figsize=(20, 6))  
sns.countplot(data=df, x=categorical_variable, palette='viridis')  
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability 
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of feature-engineered holiday_season

We can observe that relatively few vaccination rates were reported in weeks when there was a US holiday.

Code

# Custom Boolean color palette
boolean_palette = {True: 'green', False: 'red'}

# Distribution of holidays
categorical_variable = 'holiday_season'

# Create a countplot
plt.figure(figsize=(20, 6))  
sns.countplot(data=df, x=categorical_variable, palette=boolean_palette) 
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability 
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of feature-engineered vax_announcement

There are a pretty significant proportion of vaccine rate observations on a week where there was a CDC vaccine announcement. This could be because there were a lot of announcements reported, though.

Code

# Distribution of doses near vaccine announcements
categorical_variable = 'vax_announcement'

# Create a countplot
plt.figure(figsize=(20, 6))  # Set the figure size
sns.countplot(data=df, x=categorical_variable, palette=boolean_palette)  
plt.title(f'Distribution of {categorical_variable}')
plt.xlabel(categorical_variable)
plt.ylabel('Count')

# Rotate x-axis labels for better readability
plt.xticks(rotation=45)

# Show the plot
plt.show()

Distribution of Location

The observations across locations are almost completely even with around 15 less reports from Palau and around 60 less reports from the location code RP (we were unable to find this location’s corresponding state/territory name).

1.2.2.8 Bivariate Analysis

To further investigate the seasonal trends found in the STL plots we have plotted box plots of Month and Season against our prediction variable. Based on these plots we can see that the median across all categories is pretty similar. However, both November and Fall have a significanly larger IQR. This is potentially related to the fact that our data subset starts in Novemember (Fall), meaning that it had a lot of low percentage of values in 2021 when the COVID booster first came out.

Code

# visualize the monthly pred_var
features_target = df[['day_of_week', 'quarter', 'month', 'year', 'dayofyear', 'dayofmonth', 'weekofyear','season', 'holidays', 'holiday_season', 'vax_announcement','Additional_Doses_Vax_Pct_1_w_lag', pred_var,'Date']]
features_target = features_target.set_index('Date')
fig, ax = plt.subplots(figsize=(10, 8))
sns.boxplot(data=features_target, x='month', y=pred_var, palette='Blues')
ax.set_title('Booster Doses by Month')
plt.show()

Code

fig, ax = plt.subplots(figsize=(10, 8))
sns.boxplot(data=features_target, x='season', y=pred_var, palette='Blues')
ax.set_title('Booster Doses by Season')
plt.show()

1.2.2.9 Multivariate Analysis

Based on multivariate heatmaps there are few variables that have relatively high correlation with our prediction variable. These features may have contributed to some of the overfitting issues I had with model development.

Code

# Heat map to show correlation between variables
continuous_vars = df.select_dtypes(include=['float64', 'int64']).columns.tolist()
plt.figure(figsize=(10, 8))  
# Assuming 'df' is your DataFrame and 'continuous_vars' is the list of continuous variable names
plt.figure(figsize=(10, 8))
sns.heatmap(df[continuous_vars].corr(), cmap='coolwarm', linewidths=0.5)

plt.show()

<Figure size 1000x800 with 0 Axes>

Code

# Engineered feature correlations

correlation = df[continuous_vars].corr( method='pearson' )
sns.heatmap( correlation )

<Axes: >

1.3 III. Methodology

1.3.1 A. ARIMA Model

1.3.1.1 1. Data Preparation:

For the Autoregressive Integrated Moving Average Prediction (ARIMA) model, I imported solely the Date and response variable columns as the model inherently does not take any other features (Munichiello, 2023). I then grouped Date by location as ARIMA models must have one unique observation per date. Finally, I scaled the data as that has improved all of the models.

Code

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and group by 'Date'
df['Date'] = pd.to_datetime(df['Date'])
df = df.groupby('Date')[pred_var].mean()

# Sorting the DataFrame by the index
df.sort_index(inplace=True)

# Calculate the index for the 70-30 split
split_index = int(len(df) * 0.7)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(scaler.fit_transform(df.values.reshape(-1, 1)), index=df.index, columns=[pred_var])

To check the stationarity of my data, I performed the Augmented Dickey-Fuller test to see if the \(p-value ≤ 0.05\) meaning the data does not have a unit root. I also created an autocorrelation plot to show that, after around 11 lags, the autocorrelation remained between 0.25 and -0.25. Although the data passed this test, I know that stationary data have a property that the mean, variance and autocorrelation structure do not change over time (National Institute of Standards and Technology (NIST), n.d.). It is clear from the graph that both the mean and standard devation change over time. This may be because the vaccination rate was increasing so rapidly in the beginning of our dataset beforetapering off as more people got vaccinated in each Location. I believe the ADF test did not reflect this because of the cumulative nature of the dataset. For this reason, I assumed my data to be non-stationary.

Code

# Perform Augmented Dickey-Fuller test:
def test_stationarity(timeseries):

    # Determing rolling statistics
    rolling_mean = timeseries.rolling(window=12).mean()
    rolling_std = timeseries.rolling(window=12).std()

    # Plot rolling statistics:
    plt.plot(timeseries, color='blue',label='Original')
    plt.plot(rolling_mean, color='red', label='Rolling Mean')
    plt.plot(rolling_std, color='black', label = 'Rolling Std')
    plt.legend(loc='best')
    plt.title('Rolling Mean & Standard Deviation')
    plt.show(block=False)
    
    # Perform Augmented Dickey-Fuller test:
    print('Results of Dickey-Fuller Test:')
    adf_test = adfuller(timeseries, autolag='AIC')
    adf_output = pd.Series(adf_test[0:4], index=['Test Statistic','p-value','#Lags Used','Number of Observations Used'])
    for key,value in adf_test[4].items():
        adf_output['Critical Value (%s)' % key] = value
    print(adf_output)

# Testing
test_stationarity(df_scaled[pred_var])

#Autocorrelation plot
autocorrelation_plot(df_scaled[pred_var])

Results of Dickey-Fuller Test:
Test Statistic                 -4.009253
p-value                         0.001363
#Lags Used                      2.000000
Number of Observations Used    77.000000
Critical Value (1%)            -3.518281
Critical Value (5%)            -2.899878
Critical Value (10%)           -2.587223
dtype: float64

<Axes: xlabel='Lag', ylabel='Autocorrelation'>

ARIMA models are defined by several key parameters such as order and seasonal_order for seasonal data (SARIMA). Their descriptions are as follows:

• order: This parameter is a tuple (p, d, q).
  • Lag order (p): Refers to the number of lag observations included in the model, or the number of past values used for predicting the future values.
  • Degree of differencing (d): Indicates the number of times that the raw observations are differenced. This helps in making the time series stationary.
  • Moving average order (q): Represents the size of the moving average window, or the number of lagged forecast errors that should be included in the ARIMA model.
• seasonal_order: This optional parameter is a tuple (P, D, Q, s) and is used for the seasonal component of the model.
  • Seasonal auto-regressive order (P): Similar to p, but for the seasonal component of the model. It represents the number of seasonal lags of the autoregressive model.
  • Seasonal differencing (D): Similar to d, but for the seasonal component. It refers to the number of times the seasonal differences are taken to make the series stationary.
  • Seasonal moving average order (Q): Similar to q, but for the seasonal component. It indicates the number of seasonal moving average terms.
  • Time span of repeating seasonal pattern (s): Denotes the length of the seasonal cycle (Munichiello, 2023; 4.1 Seasonal ARIMA Models | STAT 510, n.d.).

1.3.1.2 2. Model Building

I began by splitting my data into a 70-30 train test split. Then, to develop my ARIMA model, it was important for me to analyze the Auto-Correlation Function (ACF) and Partial Auto-Correlation Function (PACF) plots to give me insight into potential p and q parameters. Since the ACF plot hits zero autocorrelation at around lag 14, it is clear that the effects of past values on the current value becomes negligible after about 14 periods. As for the PACF plot, it is clear that the autocorrelation drops below zero at lag four.

Code

# Calculate the index for the 70-30 split
split_index = int(len(df_scaled) * 0.7)

# Split into scaled and differenced train and test sets
train_ar = df_scaled.iloc[:split_index]
test_ar = df_scaled.iloc[split_index:]

# Plot ACF and PACF
plt.figure(figsize=(12, 6))
plt.subplot(121)
plot_acf(train_ar, ax=plt.gca(), lags=25)
plt.subplot(122)
plot_pacf(train_ar, ax=plt.gca(), lags=25)
plt.show()

Based on the plot results, I wanted to start with a lower q value and then experiment with higher values if necessary. Furthermore, I will start with \(p = 3\) as the PACF is significant at lag 3. I also included some other preliminary model specifications in the ARIMA Preliminary Models section of the appendix.

Code

# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(3, 0, 1))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
fitted_model_ar1.summary()

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

SARIMAX Results

Dep. Variable:	Additional_Doses_Vax_Pct	No. Observations:	56
Model:	ARIMA(3, 0, 1)	Log Likelihood	192.073
Date:	Mon, 27 Nov 2023	AIC	-372.146
Time:	13:49:27	BIC	-359.993
Sample:	11-03-2021	HQIC	-367.434
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
const	0.5959	0.148	4.036	0.000	0.307	0.885
ar.L1	1.1266	0.189	5.967	0.000	0.757	1.497
ar.L2	0.7027	0.369	1.905	0.057	-0.020	1.426
ar.L3	-0.8425	0.184	-4.570	0.000	-1.204	-0.481
ma.L1	0.7227	0.280	2.578	0.010	0.173	1.272
sigma2	4.939e-05	8.15e-06	6.060	0.000	3.34e-05	6.54e-05

Ljung-Box (L1) (Q):	0.53	Jarque-Bera (JB):	8.88
Prob(Q):	0.47	Prob(JB):	0.01
Heteroskedasticity (H):	0.09	Skew:	-0.38
Prob(H) (two-sided):	0.00	Kurtosis:	4.79

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

Code

# Calculate the train RMSE
train_rmse = sqrt(mean_squared_error(train_ar, fitted_model_ar1.fittedvalues))
print('The Train RMSE is {}'.format(round(train_rmse, 2)))

# Make predictions on the test set
predictions = fitted_model_ar1.predict(start=len(train_ar), end=len(train_ar) + len(test_ar) - 1, dynamic=False)
# Calculate the test RMSE
test_rmse = sqrt(mean_squared_error(test_ar, predictions))
print('The Test RMSE is {}'.format(round(test_rmse, 2)))

The Train RMSE is 0.08
The Test RMSE is 0.26

To refine further, however, I wanted to look at other specifications by iterating over different p,d,q combinations based on the initial insights from the plots. Since the data have been proven not to be stationary, I wanted to explore d values greater than 0 to potentially increase model robustness and accuracy by differencing the data.

Therefore, I defined the p,d, and q parameter range to perform a grid search over the different combinations. I fit each ARIMA model to the training data, calculate the Akaike Information Criterion (AIC) for model comparison, and compute the Root Mean Square Error (RMSE) on the test data for each parameter combination to evaluate model accuracy. I then identify the best-performing model based on both the lowest AIC and test RMSE, respectively, and print the model summary.

After consulting with my teammates, they mentioned that they implemented a rolling forecast origin approach to their ARIMA model. Instead of just predicting on the test set from the beginning to the end of the indices, they implemented a rolling forecast so that the model is retrained for every new prediction in the test set. This is supposed to ensure more accurate and adaptive predictive capabilities (Brownlee, 2023). I decided to try this as well to see if I could improve my ARIMA results, and it did not. However, I included those results below. Some of my other less successful ARIMA tunings can be found in the ARIMA section of the appendix.

The best performing model I found used the parameters (0,1,6).

Normal Tuning

Code

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Predict on the test set and calculate RMSE
        test_pred = results.predict(start=test_ar.index[0], end=test_ar.index[-1], dynamic=False)
        test_rmse = np.sqrt(mean_squared_error(test_ar, test_pred))
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 0) - AIC:4.247377915841888
ARIMA(0, 0, 0) - Test RMSE: 0.23350429504237882
ARIMA(0, 0, 1) - AIC:-61.386166557230766
ARIMA(0, 0, 1) - Test RMSE: 0.23563160917092582
ARIMA(0, 0, 2) - AIC:-120.75241682724243
ARIMA(0, 0, 2) - Test RMSE: 0.23827322868086245
ARIMA(0, 0, 3) - AIC:-167.77581727403606
ARIMA(0, 0, 3) - Test RMSE: 0.2450247838181501
ARIMA(0, 0, 4) - AIC:-208.98721984355345
ARIMA(0, 0, 4) - Test RMSE: 0.24176701301825643
ARIMA(0, 0, 5) - AIC:-238.79317806887153
ARIMA(0, 0, 5) - Test RMSE: 0.24330099657704457
ARIMA(0, 0, 6) - AIC:-260.72140641203134
ARIMA(0, 0, 6) - Test RMSE: 0.24630483027520078
ARIMA(0, 1, 0) - AIC:-233.93423132271894
ARIMA(0, 1, 0) - Test RMSE: 0.023575872585425713
ARIMA(0, 1, 1) - AIC:-281.8755026362179
ARIMA(0, 1, 1) - Test RMSE: 0.021703558248683898
ARIMA(0, 1, 2) - AIC:-317.04502425321454
ARIMA(0, 1, 2) - Test RMSE: 0.0201882822743985
ARIMA(0, 1, 3) - AIC:-334.6221693724792
ARIMA(0, 1, 3) - Test RMSE: 0.014583201227370708

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 4) - AIC:-341.17129968294756
ARIMA(0, 1, 4) - Test RMSE: 0.013322866549782732
ARIMA(0, 1, 5) - AIC:-344.26377726332
ARIMA(0, 1, 5) - Test RMSE: 0.013634877951547084
ARIMA(0, 1, 6) - AIC:-354.75089008501647
ARIMA(0, 1, 6) - Test RMSE: 0.009937797182224015
ARIMA(0, 2, 0) - AIC:-381.44345120781577
ARIMA(0, 2, 0) - Test RMSE: 0.040002527192291915
ARIMA(0, 2, 1) - AIC:-382.8312301530113
ARIMA(0, 2, 1) - Test RMSE: 0.03787599765300815
ARIMA(0, 2, 2) - AIC:-380.8791307958302
ARIMA(0, 2, 2) - Test RMSE: 0.037604675379974556
ARIMA(0, 2, 3) - AIC:-378.92034573917493
ARIMA(0, 2, 3) - Test RMSE: 0.03743234988239117

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 4) - AIC:-385.57523592106753
ARIMA(0, 2, 4) - Test RMSE: 0.03231499129382203
ARIMA(0, 2, 5) - AIC:-382.91815096136696
ARIMA(0, 2, 5) - Test RMSE: 0.04199302233056776
ARIMA(0, 2, 6) - AIC:-383.45095430858504
ARIMA(0, 2, 6) - Test RMSE: 0.04041100035020977
ARIMA(1, 0, 0) - AIC:-228.61918020716223
ARIMA(1, 0, 0) - Test RMSE: 0.03531958289162262
ARIMA(1, 0, 1) - AIC:-269.24796001003426
ARIMA(1, 0, 1) - Test RMSE: 0.04874606400987704
ARIMA(1, 0, 2) - AIC:-307.1027082494086
ARIMA(1, 0, 2) - Test RMSE: 0.042940251203072044
ARIMA(1, 0, 3) - AIC:-329.1694480883456
ARIMA(1, 0, 3) - Test RMSE: 0.0365148932957402

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 4) - AIC:-335.013299468729
ARIMA(1, 0, 4) - Test RMSE: 0.06287603251109312
ARIMA(1, 0, 5) - AIC:-337.7136153956957
ARIMA(1, 0, 5) - Test RMSE: 0.07391378248693989
ARIMA(1, 0, 6) - AIC:-332.4450350634247
ARIMA(1, 0, 6) - Test RMSE: 0.22618906304649647
ARIMA(1, 1, 0) - AIC:-382.877948427655
ARIMA(1, 1, 0) - Test RMSE: 0.027128500099903603

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 1) - AIC:-384.23718277178415
ARIMA(1, 1, 1) - Test RMSE: 0.032487286494587486
ARIMA(1, 1, 2) - AIC:-382.3689356103163
ARIMA(1, 1, 2) - Test RMSE: 0.033155757325325864
ARIMA(1, 1, 3) - AIC:-374.2438675173964
ARIMA(1, 1, 3) - Test RMSE: 0.013461639971627658
ARIMA(1, 1, 4) - AIC:-387.97730073335714
ARIMA(1, 1, 4) - Test RMSE: 0.01785447830243275

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 5) - AIC:-388.7020424979628
ARIMA(1, 1, 5) - Test RMSE: 0.015078569479815946
ARIMA(1, 1, 6) - AIC:-388.4099480064063
ARIMA(1, 1, 6) - Test RMSE: 0.020924211162350183
ARIMA(1, 2, 0) - AIC:-382.8776751931645
ARIMA(1, 2, 0) - Test RMSE: 0.03768944679741849
ARIMA(1, 2, 1) - AIC:-380.87007247939215
ARIMA(1, 2, 1) - Test RMSE: 0.03784318480267536
ARIMA(1, 2, 2) - AIC:-375.7907461572404
ARIMA(1, 2, 2) - Test RMSE: 0.10997274638119175
ARIMA(1, 2, 3) - AIC:-377.41886357440137
ARIMA(1, 2, 3) - Test RMSE: 0.036931397430668415
ARIMA(1, 2, 4) - AIC:-383.63415198973996
ARIMA(1, 2, 4) - Test RMSE: 0.027857734773898704

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 5) - AIC:-385.0860947023966
ARIMA(1, 2, 5) - Test RMSE: 0.03891368386925232
ARIMA(1, 2, 6) - AIC:-382.50216905749863
ARIMA(1, 2, 6) - Test RMSE: 0.04814229206077891
ARIMA(2, 0, 0) - AIC:-373.16946963052357
ARIMA(2, 0, 0) - Test RMSE: 0.26785937635451923
ARIMA(2, 0, 1) - AIC:-376.1986841777029
ARIMA(2, 0, 1) - Test RMSE: 0.2302198362751503

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 2) - AIC:-282.4086129935133
ARIMA(2, 0, 2) - Test RMSE: 0.042401390496491935
ARIMA(2, 0, 3) - AIC:-311.3186709873355
ARIMA(2, 0, 3) - Test RMSE: 0.07649427150332398
ARIMA(2, 0, 4) - AIC:-328.1302481051966
ARIMA(2, 0, 4) - Test RMSE: 0.04088353075973026

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 5) - AIC:-331.6524564508811
ARIMA(2, 0, 5) - Test RMSE: 0.05098796116315466
ARIMA(2, 0, 6) - AIC:-292.10284992382935
ARIMA(2, 0, 6) - Test RMSE: 0.4137898362441912
ARIMA(2, 1, 0) - AIC:-384.368303927542
ARIMA(2, 1, 0) - Test RMSE: 0.03295018013107606
ARIMA(2, 1, 1) - AIC:-382.1998843707397
ARIMA(2, 1, 1) - Test RMSE: 0.03165330965310442
ARIMA(2, 1, 2) - AIC:-380.8129483990026
ARIMA(2, 1, 2) - Test RMSE: 0.03438531513038868

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 3) - AIC:-378.72694645280524
ARIMA(2, 1, 3) - Test RMSE: 0.035259715041872086
ARIMA(2, 1, 4) - AIC:-377.06711037555243
ARIMA(2, 1, 4) - Test RMSE: 0.025298754081975256
ARIMA(2, 1, 5) - AIC:-384.2577072621762
ARIMA(2, 1, 5) - Test RMSE: 0.024082589438175914

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 6) - AIC:-386.6125135638169
ARIMA(2, 1, 6) - Test RMSE: 0.02527410092215167
ARIMA(2, 2, 0) - AIC:-380.8901883396523
ARIMA(2, 2, 0) - Test RMSE: 0.03768274777956401
ARIMA(2, 2, 1) - AIC:-378.89418192149424
ARIMA(2, 2, 1) - Test RMSE: 0.03769891905870269
ARIMA(2, 2, 2) - AIC:-376.90090791610766
ARIMA(2, 2, 2) - Test RMSE: 0.037682208229094606
ARIMA(2, 2, 3) - AIC:-378.4137824836483
ARIMA(2, 2, 3) - Test RMSE: 0.0346530674415241
ARIMA(2, 2, 4) - AIC:-381.2931815248008
ARIMA(2, 2, 4) - Test RMSE: 0.03737151251748326

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 5) - AIC:-383.15434495370494
ARIMA(2, 2, 5) - Test RMSE: 0.0315477581160997
ARIMA(2, 2, 6) - AIC:-382.9672222960308
ARIMA(2, 2, 6) - Test RMSE: 0.03800766679007163
ARIMA(1, 1, 5) with lowest AIC of -388.7020424979628
ARIMA(0, 1, 6) with lowest test RMSE of 0.009937797182224015
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 1, 5)   Log Likelihood                 201.351
Date:                      Mon, 27 Nov 2023   AIC                           -388.702
Time:                              13:52:09   BIC                           -374.651
Sample:                          11-03-2021   HQIC                          -383.268
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.9451      0.022     42.845      0.000       0.902       0.988
ma.L1         -0.3162      0.200     -1.584      0.113      -0.707       0.075
ma.L2          0.1448      0.158      0.915      0.360      -0.165       0.455
ma.L3         -0.0399      0.198     -0.201      0.840      -0.428       0.348
ma.L4          0.2786      0.242      1.153      0.249      -0.195       0.752
ma.L5          0.3989      0.215      1.854      0.064      -0.023       0.821
sigma2      3.529e-05   1.27e-05      2.787      0.005    1.05e-05    6.01e-05
===================================================================================
Ljung-Box (L1) (Q):                   1.41   Jarque-Bera (JB):                20.36
Prob(Q):                              0.24   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.79
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.53
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(0, 1, 6) - Train RMSE: 0.011998272241271278
Best ARIMA(0, 1, 6) - Test RMSE: 0.009937797182224015

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Code

# Define the ARIMA order
arima_order016 = (0, 1, 6)

# Fit the ARIMA model
model016 = ARIMA(train_ar, order=arima_order016)
fitted_model016 = model016.fit()

# Predict on the training set
train_pred_ar016 = fitted_model016.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar016 = fitted_model016.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar016 = np.sqrt(mean_squared_error(train_ar, train_pred_ar016))
test_rmse_ar016 = np.sqrt(mean_squared_error(test_ar, test_pred_ar016))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar016}")
print(f"Test RMSE: {test_rmse_ar016}")

# Model summary
fitted_model016.summary()

Train RMSE: 0.011998272241271278
Test RMSE: 0.009937797182224015

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

SARIMAX Results

Dep. Variable:	Additional_Doses_Vax_Pct	No. Observations:	56
Model:	ARIMA(0, 1, 6)	Log Likelihood	184.375
Date:	Mon, 27 Nov 2023	AIC	-354.751
Time:	13:53:03	BIC	-340.700
Sample:	11-03-2021	HQIC	-349.317
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
ma.L1	0.9042	0.124	7.290	0.000	0.661	1.147
ma.L2	1.1057	0.200	5.520	0.000	0.713	1.498
ma.L3	0.8995	0.171	5.270	0.000	0.565	1.234
ma.L4	0.9681	0.303	3.197	0.001	0.375	1.562
ma.L5	0.7690	0.245	3.134	0.002	0.288	1.250
ma.L6	0.5635	0.253	2.227	0.026	0.067	1.060
sigma2	6.824e-05	1.75e-05	3.894	0.000	3.39e-05	0.000

Ljung-Box (L1) (Q):	0.02	Jarque-Bera (JB):	59.44
Prob(Q):	0.88	Prob(JB):	0.00
Heteroskedasticity (H):	0.05	Skew:	1.61
Prob(H) (two-sided):	0.00	Kurtosis:	6.94

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

Rolling Forecast Tuning

Code

# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    error = mean_squared_error(test_data, predictions)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ar.values, test_ar.values, param)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 0) - AIC:4.247377915841888
ARIMA(0, 0, 0) - Test RMSE: 0.19689682599508618
ARIMA(0, 0, 1) - AIC:-61.386166557230766
ARIMA(0, 0, 1) - Test RMSE: 0.1019191370564995
ARIMA(0, 0, 2) - AIC:-120.75241682724243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 2) - Test RMSE: 0.057198496179134306
ARIMA(0, 0, 3) - AIC:-167.77581727403606

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 3) - Test RMSE: 0.03252307691385174
ARIMA(0, 0, 4) - AIC:-208.98721984355345

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 4) - Test RMSE: 0.024613571459282953
ARIMA(0, 0, 5) - AIC:-238.79317806887153

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 5) - Test RMSE: 0.014536313016410257
ARIMA(0, 0, 6) - AIC:-260.72140641203134

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 6) - Test RMSE: 0.012105676352473728
ARIMA(0, 1, 0) - AIC:-233.93423132271894
ARIMA(0, 1, 0) - Test RMSE: 0.001638176583743459
ARIMA(0, 1, 1) - AIC:-281.8755026362179

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 1) - Test RMSE: 0.0010609016327302642
ARIMA(0, 1, 2) - AIC:-317.04502425321454

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 2) - Test RMSE: 0.0009347626816272875
ARIMA(0, 1, 3) - AIC:-334.6221693724792

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 3) - Test RMSE: 0.0014870537589369954
ARIMA(0, 1, 4) - AIC:-341.17129968294756

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 4) - Test RMSE: 0.0010917579260762474
ARIMA(0, 1, 5) - AIC:-344.26377726332

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 5) - Test RMSE: 0.0009591114496682588
ARIMA(0, 1, 6) - AIC:-354.75089008501647

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 6) - Test RMSE: 0.0013058042895714801
ARIMA(0, 2, 0) - AIC:-381.44345120781577

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 0) - Test RMSE: 0.0007879147333206601
ARIMA(0, 2, 1) - AIC:-382.8312301530113
ARIMA(0, 2, 1) - Test RMSE: 0.0007342490373780269
ARIMA(0, 2, 2) - AIC:-380.8791307958302

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 2) - Test RMSE: 0.0007314521796732864
ARIMA(0, 2, 3) - AIC:-378.92034573917493

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 3) - Test RMSE: 0.0007325634592131251
ARIMA(0, 2, 4) - AIC:-385.57523592106753

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 4) - Test RMSE: 0.001159241575397781
ARIMA(0, 2, 5) - AIC:-382.91815096136696

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 5) - Test RMSE: 0.0010718138463683647
ARIMA(0, 2, 6) - AIC:-383.45095430858504

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 6) - Test RMSE: 0.0009897008141751056
ARIMA(1, 0, 0) - AIC:-228.61918020716223

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 0) - Test RMSE: 0.0022737166421355733
ARIMA(1, 0, 1) - AIC:-269.24796001003426

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 1) - Test RMSE: 0.005404585931399144
ARIMA(1, 0, 2) - AIC:-307.1027082494086

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 2) - Test RMSE: 0.004365683947512756
ARIMA(1, 0, 3) - AIC:-329.1694480883456

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 3) - Test RMSE: 0.0020964879671221295
ARIMA(1, 0, 4) - AIC:-335.013299468729

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 4) - Test RMSE: 0.0023322136470668876
ARIMA(1, 0, 5) - AIC:-337.7136153956957

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 5) - Test RMSE: 0.0020479490548349077
ARIMA(1, 0, 6) - AIC:-332.4450350634247

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 6) - Test RMSE: 0.0034189651106060295
ARIMA(1, 1, 0) - AIC:-382.877948427655

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 0) - Test RMSE: 0.0007732110928795112
ARIMA(1, 1, 1) - AIC:-384.23718277178415

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 1) - Test RMSE: 0.0007252399068664201
ARIMA(1, 1, 2) - AIC:-382.3689356103163

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 2) - Test RMSE: 0.0007249542934853802
ARIMA(1, 1, 3) - AIC:-374.2438675173964

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 3) - Test RMSE: 0.000782814395861608
ARIMA(1, 1, 4) - AIC:-387.97730073335714

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 4) - Test RMSE: 0.0017134809487848687
ARIMA(1, 1, 5) - AIC:-388.7020424979628

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 5) - Test RMSE: 0.0011155590927342265
ARIMA(1, 1, 6) - AIC:-388.4099480064063

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 6) - Test RMSE: 0.00123734818874504
ARIMA(1, 2, 0) - AIC:-382.8776751931645

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 0) - Test RMSE: 0.0007381664319877718
ARIMA(1, 2, 1) - AIC:-380.87007247939215

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 1) - Test RMSE: 0.0007364183066952584
ARIMA(1, 2, 2) - AIC:-375.7907461572404

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 2) - Test RMSE: 0.0011117819342048353
ARIMA(1, 2, 3) - AIC:-377.41886357440137

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 3) - Test RMSE: 0.0007288358572307232
ARIMA(1, 2, 4) - AIC:-383.63415198973996

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 4) - Test RMSE: 0.0010112311290048517
ARIMA(1, 2, 5) - AIC:-385.0860947023966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 5) - Test RMSE: 0.001005185695742508
ARIMA(1, 2, 6) - AIC:-382.50216905749863

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 6) - Test RMSE: 0.0010431592839520952
ARIMA(2, 0, 0) - AIC:-373.16946963052357

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 0) - Test RMSE: 0.0021560403099509877
ARIMA(2, 0, 1) - AIC:-376.1986841777029

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 1) - Test RMSE: 0.0023064402318947615
ARIMA(2, 0, 2) - AIC:-282.4086129935133

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 2) - Test RMSE: 0.0027854421827834
ARIMA(2, 0, 3) - AIC:-311.3186709873355

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 3) - Test RMSE: 0.0017284632612331557
ARIMA(2, 0, 4) - AIC:-328.1302481051966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 4) - Test RMSE: 0.001821546705616348
ARIMA(2, 0, 5) - AIC:-331.6524564508811

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 5) - Test RMSE: 0.0016393788620216896
ARIMA(2, 0, 6) - AIC:-292.10284992382935

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 6) - Test RMSE: 0.008405113630402087
ARIMA(2, 1, 0) - AIC:-384.368303927542

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 0) - Test RMSE: 0.0007367568552582056
ARIMA(2, 1, 1) - AIC:-382.1998843707397

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 1) - Test RMSE: 0.0007578723701840571
ARIMA(2, 1, 2) - AIC:-380.8129483990026

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 2) - Test RMSE: 0.0007433679604867638
ARIMA(2, 1, 3) - AIC:-378.72694645280524

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 3) - Test RMSE: 0.0007581204748123403
ARIMA(2, 1, 4) - AIC:-377.06711037555243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 4) - Test RMSE: 0.0007194634650386461
ARIMA(2, 1, 5) - AIC:-384.2577072621762

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 5) - Test RMSE: 0.001167145444086536
ARIMA(2, 1, 6) - AIC:-386.6125135638169

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 6) - Test RMSE: 0.001159203264746481
ARIMA(2, 2, 0) - AIC:-380.8901883396523

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 0) - Test RMSE: 0.0007360772804361125
ARIMA(2, 2, 1) - AIC:-378.89418192149424

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 1) - Test RMSE: 0.000735186059287429
ARIMA(2, 2, 2) - AIC:-376.90090791610766

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 2) - Test RMSE: 0.000731458173655972
ARIMA(2, 2, 3) - AIC:-378.4137824836483

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 3) - Test RMSE: 0.0007085978823558145
ARIMA(2, 2, 4) - AIC:-381.2931815248008

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 4) - Test RMSE: 0.0007603620097464024
ARIMA(2, 2, 5) - AIC:-383.15434495370494

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 5) - Test RMSE: 0.0009086549859147037
ARIMA(2, 2, 6) - AIC:-382.9672222960308

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 6) - Test RMSE: 0.001136232470792607
ARIMA(1, 1, 5) with lowest AIC of -388.7020424979628
ARIMA(2, 2, 3) with lowest test RMSE of 0.0007085978823558145
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 1, 5)   Log Likelihood                 201.351
Date:                      Mon, 27 Nov 2023   AIC                           -388.702
Time:                              13:55:15   BIC                           -374.651
Sample:                          11-03-2021   HQIC                          -383.268
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.9451      0.022     42.845      0.000       0.902       0.988
ma.L1         -0.3162      0.200     -1.584      0.113      -0.707       0.075
ma.L2          0.1448      0.158      0.915      0.360      -0.165       0.455
ma.L3         -0.0399      0.198     -0.201      0.840      -0.428       0.348
ma.L4          0.2786      0.242      1.153      0.249      -0.195       0.752
ma.L5          0.3989      0.215      1.854      0.064      -0.023       0.821
sigma2      3.529e-05   1.27e-05      2.787      0.005    1.05e-05    6.01e-05
===================================================================================
Ljung-Box (L1) (Q):                   1.41   Jarque-Bera (JB):                20.36
Prob(Q):                              0.24   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.79
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.53
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 3) - Train RMSE: 0.011363769653325214
Best ARIMA(2, 2, 3) - Test RMSE: 0.0007085978823558145

Code

# Define the ARIMA order
arima_order223 = (2, 2, 3)

# Fit the ARIMA model
model223 = ARIMA(train_ar, order=arima_order223)
fitted_model223 = model223.fit()

# Predict on the training set
train_pred_ar223 = fitted_model223.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar223 = fitted_model223.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar223 = np.sqrt(mean_squared_error(train_ar, train_pred_ar223))
test_rmse_ar223 = np.sqrt(mean_squared_error(test_ar, test_pred_ar223))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar223}")
print(f"Test RMSE: {test_rmse_ar223}")

# Model summary
fitted_model223.summary()

Train RMSE: 0.011363769653325214
Test RMSE: 0.0346530674415241

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

SARIMAX Results

Dep. Variable:	Additional_Doses_Vax_Pct	No. Observations:	56
Model:	ARIMA(2, 2, 3)	Log Likelihood	195.207
Date:	Mon, 27 Nov 2023	AIC	-378.414
Time:	13:56:16	BIC	-366.480
Sample:	11-03-2021	HQIC	-373.811
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
ar.L1	0.2149	0.583	0.369	0.712	-0.927	1.357
ar.L2	0.3947	0.602	0.656	0.512	-0.784	1.574
ma.L1	-0.6747	0.543	-1.242	0.214	-1.739	0.390
ma.L2	-0.2652	0.751	-0.353	0.724	-1.738	1.207
ma.L3	0.3844	0.338	1.137	0.255	-0.278	1.047
sigma2	4.194e-05	5.77e-06	7.269	0.000	3.06e-05	5.33e-05

Ljung-Box (L1) (Q):	0.19	Jarque-Bera (JB):	17.89
Prob(Q):	0.67	Prob(JB):	0.00
Heteroskedasticity (H):	0.01	Skew:	-0.33
Prob(H) (two-sided):	0.00	Kurtosis:	5.74

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

For models without seasonality, I achieved the best results after scaling my data and performing a loop to tune for the p,d,q values. Although there does not appear to be any seasonality in visuals I have plotted of the data, next, I experimented with seasonality to see if I could improve my model further. I trained a base model on the scaled data with the best non-seasonal parameters found in my last tuning and P = D = Q = 1. However, I was unable to achieve an RMSE lower than that without a seasonality parameter, confirming my suspicions.

Code

# Fit SARIMA model
p, d, q = 0, 1, 6  # Non-seasonal parameters
P, D, Q, s = 1, 1, 1, 13  # Seasonal parameters 

model = SARIMAX(train_ar, order=(p, d, q), seasonal_order=(P, D, Q, s))
fitted_model = model.fit()

# Predict on the training set
train_pred_scaled = fitted_model.predict(start=0, end=len(train_ar)-1)

# Predict on the test set
test_pred_scaled = fitted_model.predict(start=len(train_ar), end=len(train_ar) + len(test_ar) - 1)

# Calculate RMSE for train and test sets (on scaled data)
train_rmse_scaled = np.sqrt(mean_squared_error(train_ar, train_pred_scaled))
test_rmse_scaled = np.sqrt(mean_squared_error(test_ar, test_pred_scaled))

# Print RMSE values
print(f"Train RMSE (Seasonal): {train_rmse_scaled}")
print(f"Test RMSE (Seasonal): {test_rmse_scaled}")

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
 This problem is unconstrained.

RUNNING THE L-BFGS-B CODE

           * * *

Machine precision = 2.220D-16
 N =            9     M =           10

At X0         0 variables are exactly at the bounds

At iterate    0    f=  5.41181D+00    |proj g|=  3.51632D+03

At iterate    5    f= -1.77848D+00    |proj g|=  1.36500D+00

At iterate   10    f= -2.25951D+00    |proj g|=  2.34798D+01

At iterate   15    f= -2.32049D+00    |proj g|=  2.34528D-01

At iterate   20    f= -2.37498D+00    |proj g|=  9.38885D+00

At iterate   25    f= -2.37852D+00    |proj g|=  1.94988D-01

           * * *

Tit   = total number of iterations
Tnf   = total number of function evaluations
Tnint = total number of segments explored during Cauchy searches
Skip  = number of BFGS updates skipped
Nact  = number of active bounds at final generalized Cauchy point
Projg = norm of the final projected gradient
F     = final function value

           * * *

   N    Tit     Tnf  Tnint  Skip  Nact     Projg        F
    9     26     68      1     0     0   1.950D-01  -2.379D+00
  F =  -2.3785187708029292     

CONVERGENCE: REL_REDUCTION_OF_F_<=_FACTR*EPSMCH             
Train RMSE (Seasonal): 0.029303014306120576
Test RMSE (Seasonal): 0.046987416092090485

 Warning:  more than 10 function and gradient
   evaluations in the last line search.  Termination
   may possibly be caused by a bad search direction.

1.3.1.3 3. Model Performance

The best parameter values I obtained were (0,1,6). This indicates a first-order differencing, and a sixth-order moving average part. Below are visualizations showing how my train and test predictions for the best non-seasonal ARIMA model I created compare to the actual values. I also included the RMSEs and model summary for reference again. It is important to note how unusual it is that the test RMSE is lower than that of the train data. I believe, however, this is due to the cumulative nature of the dataset used. Since the Locations are reaching near 100% vaccination rates, the trend is much less complex in our test set. Therefore, I think this simplicity and slow increase is lending itself to a highly accurate test rate.

The log likelihood is quite high and the AIC and BIC are both very low (negative) indicating a good model fit. Furthermore, the \(P>|z|\) Values for the AR and MA terms are all less than 0.05 aside, suggesting that the coefficients for the AR and MA terms are all significantly different from zero and have notable impact on the model. Also, the low sigma2 term suggests less unexplained variation in the model. The Ljung-Box Test has a high p-value which indicates that there is no significant autocorrelation at this lag.

However, the Jarque-Bero test suggests that the residuals are not normally distributed. Furthermore, there are potential heteroskedastic residuals, suggesting that the model may not be appropriately capturing the underlying process. Additionally, the residuals have a high skew and kurtosis which bolster my claim about the undesireable residual pattern.

I show the results of cross validation below to further bolster my assessment.

Code

# Define the ARIMA order
arima_order016 = (0, 1, 6)

# Fit the ARIMA model
model016 = ARIMA(train_ar, order=arima_order016)
fitted_model016 = model016.fit()

# Predict on the training set
train_pred_ar016 = fitted_model016.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar016 = fitted_model016.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar016 = np.sqrt(mean_squared_error(train_ar, train_pred_ar016))
test_rmse_ar016 = np.sqrt(mean_squared_error(test_ar, test_pred_ar016))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar016}")
print(f"Test RMSE: {test_rmse_ar016}")

# Plotting
plt.figure(figsize=(15, 6))

# Train Data Plot
plt.subplot(1, 2, 1)
plt.plot(train_ar, label='Actual')
plt.plot(train_pred_ar016, label='Predicted')
plt.title('Train Data: Actual vs Predicted')
plt.xlabel('Time')
plt.ylabel('Vaccination Percentage')
plt.legend()

# Test Data Plot
plt.subplot(1, 2, 2)
plt.plot(test_ar, label='Actual')
plt.plot(test_pred_ar016, label='Predicted')
plt.title('Test Data: Actual vs Predicted')
plt.xlabel('Time')
plt.ylabel('Vaccination Percentage')
plt.legend()

plt.tight_layout()
plt.show()

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Train RMSE: 0.011998272241271278
Test RMSE: 0.009937797182224015

Code

# Model summary
fitted_model016.summary()

SARIMAX Results

Dep. Variable:	Additional_Doses_Vax_Pct	No. Observations:	56
Model:	ARIMA(0, 1, 6)	Log Likelihood	184.375
Date:	Mon, 27 Nov 2023	AIC	-354.751
Time:	14:02:13	BIC	-340.700
Sample:	11-03-2021	HQIC	-349.317
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
ma.L1	0.9042	0.124	7.290	0.000	0.661	1.147
ma.L2	1.1057	0.200	5.520	0.000	0.713	1.498
ma.L3	0.8995	0.171	5.270	0.000	0.565	1.234
ma.L4	0.9681	0.303	3.197	0.001	0.375	1.562
ma.L5	0.7690	0.245	3.134	0.002	0.288	1.250
ma.L6	0.5635	0.253	2.227	0.026	0.067	1.060
sigma2	6.824e-05	1.75e-05	3.894	0.000	3.39e-05	0.000

Ljung-Box (L1) (Q):	0.02	Jarque-Bera (JB):	59.44
Prob(Q):	0.88	Prob(JB):	0.00
Heteroskedasticity (H):	0.05	Skew:	1.61
Prob(H) (two-sided):	0.00	Kurtosis:	6.94

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

Code

def cross_validated_rmse(data, order, num_folds):
    fold_size = int(len(data) / num_folds)
    rmse_values = []

    for i in range(num_folds):
        train_end = i * fold_size + fold_size
        test_end = train_end + fold_size
        if test_end > len(data):
            test_end = len(data)
        
        train_data = data[:train_end]
        test_data = data[train_end:test_end]

        # Fit the ARIMA model
        model = ARIMA(train_data, order=order)
        model_fit = model.fit()

        # Forecast
        forecast = model_fit.forecast(steps=len(test_data))

        # Calculate RMSE and append to the list
        rmse = sqrt(mean_squared_error(test_data, forecast))
        rmse_values.append(rmse)

    return np.mean(rmse_values), rmse_values

# Example usage
order = (0, 1, 6)
num_folds = 3
average_rmse, all_rmse_values = cross_validated_rmse(df_scaled[pred_var], order, num_folds)
print(f'Average RMSE: {average_rmse}')

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Average RMSE: 0.019361682068568847

1.3.2 B. auto_arima Model

1.3.2.1 1. Data Preparation:

The data preparation for auto_arima is identical to that of ARIMA as I simply only select the Date column and response variable, group the data by observation Date, and then do a 70-30 train-test split. I also scaled the data for comparison with the other models and because of its succcess in other models. While I considered differencing the data myself, I decided that it was unecessary since the d parameter in the auto_arima takes care of this. I worried that if I manually differenced the data before passing it to auto_arima it could lead to over-differencing, where the time series becomes too “flat,” losing valuable information.

Code

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and group by 'Date'
df['Date'] = pd.to_datetime(df['Date'])
df = df.groupby('Date')[pred_var].mean()

# Sorting the DataFrame by the index
df.sort_index(inplace=True)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(scaler.fit_transform(df.values.reshape(-1, 1)), index=df.index, columns=[pred_var])

# Calculate the index for the 70-30 split
split_index = int(len(df_scaled) * 0.7)

# Split into scaled and differenced train and test sets
train_aar = df_scaled.iloc[:split_index]
test_aar = df_scaled.iloc[split_index:]

Some of auto_arima’s key parameters are as follows:

start_p, start_q, max_p, max_q: The starting and maximum values of the AR (p) and MA (q) terms.

d: The order of first-differencing. If None, it is determined automatically through tests such as ADF.

start_P, start_Q, max_P, max_Q: The starting and maximum values for the seasonal part of the model.

D: The order of seasonal differencing. If None, it will be determined through the seasonal_test.

seasonal: Condition to fit a seasonal ARIMA.

m: The number of periods per season.

stepwise: Applies the stepwise algorithm.

information_criterion: Metric used for model selection.

max_order: Maximum value of p+q+P+Q to suppress overcomplexity.

out_of_sample_size: The number of samples to use for out-of-bag (OOB) statistics ((Smith et al., 2017).

The difference between ARIMA and auto_arima is that the latter iteratively and automatically determines the best parameters for the model. ARIMA, in comparison, must be manually tuned.

1.3.2.2 2. Model Building

Below I run auto_arima to find the optimal SARIMA model parameters. Based on the information I gained from developing the ARIMA model, I decided to define the range of the p, and q parameters as between 0 and 7, d=1, and, after trying a few different numbers, I set m = 24 because that gave me the best result. Finally, I set stepwise = False because I wanted to do a comprehensive search. If it was set to True it might miss the optimal parameters if they are located far from the starting point in the parameter space as stepwise = True employs a more efficient approach by looking at neighboring models to the iteratively best one. Although it did not help in my previous ARIMA models, for some reason setting seasonality = True greatly improves my test RMSE.

I tried some other variations of the model changing parameters such as m. However, the approach I took below gave me the most successful results. The other models can be found in the Other auto_arima Models section of the appendix.

Code

# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")

 ARIMA(0,2,0)(0,1,0)[24]             : AIC=-194.449, Time=0.07 sec
 ARIMA(0,2,0)(0,1,1)[24]             : AIC=-192.449, Time=0.35 sec
 ARIMA(0,2,0)(0,1,2)[24]             : AIC=-190.449, Time=2.34 sec
 ARIMA(0,2,0)(1,1,0)[24]             : AIC=-192.449, Time=0.20 sec
 ARIMA(0,2,0)(1,1,1)[24]             : AIC=-190.449, Time=0.35 sec
 ARIMA(0,2,0)(1,1,2)[24]             : AIC=-188.449, Time=2.22 sec
 ARIMA(0,2,0)(2,1,0)[24]             : AIC=-190.449, Time=0.80 sec
 ARIMA(0,2,0)(2,1,1)[24]             : AIC=-188.449, Time=1.36 sec
 ARIMA(0,2,0)(2,1,2)[24]             : AIC=-186.449, Time=1.35 sec
 ARIMA(0,2,1)(0,1,0)[24]             : AIC=-194.685, Time=0.10 sec
 ARIMA(0,2,1)(0,1,1)[24]             : AIC=-192.685, Time=0.57 sec
 ARIMA(0,2,1)(0,1,2)[24]             : AIC=-190.685, Time=1.17 sec
 ARIMA(0,2,1)(1,1,0)[24]             : AIC=-192.685, Time=0.81 sec
 ARIMA(0,2,1)(1,1,1)[24]             : AIC=-190.685, Time=0.60 sec
 ARIMA(0,2,1)(1,1,2)[24]             : AIC=-188.685, Time=1.74 sec
 ARIMA(0,2,1)(2,1,0)[24]             : AIC=-190.685, Time=1.27 sec
 ARIMA(0,2,1)(2,1,1)[24]             : AIC=-188.685, Time=1.67 sec
 ARIMA(0,2,1)(2,1,2)[24]             : AIC=-186.685, Time=3.54 sec
 ARIMA(0,2,2)(0,1,0)[24]             : AIC=-192.580, Time=0.29 sec
 ARIMA(0,2,2)(0,1,1)[24]             : AIC=-189.234, Time=1.46 sec
 ARIMA(0,2,2)(0,1,2)[24]             : AIC=-187.018, Time=6.16 sec
 ARIMA(0,2,2)(1,1,0)[24]             : AIC=-190.381, Time=1.32 sec
 ARIMA(0,2,2)(1,1,1)[24]             : AIC=-188.156, Time=1.85 sec
 ARIMA(0,2,2)(1,1,2)[24]             : AIC=-184.976, Time=3.20 sec
 ARIMA(0,2,2)(2,1,0)[24]             : AIC=-187.285, Time=8.36 sec
 ARIMA(0,2,2)(2,1,1)[24]             : AIC=-184.977, Time=2.98 sec
 ARIMA(0,2,3)(0,1,0)[24]             : AIC=-190.595, Time=0.33 sec
 ARIMA(0,2,3)(0,1,1)[24]             : AIC=-189.068, Time=1.77 sec
 ARIMA(0,2,3)(0,1,2)[24]             : AIC=-187.340, Time=3.79 sec
 ARIMA(0,2,3)(1,1,0)[24]             : AIC=-188.505, Time=1.18 sec
 ARIMA(0,2,3)(1,1,1)[24]             : AIC=-187.171, Time=2.25 sec
 ARIMA(0,2,3)(2,1,0)[24]             : AIC=-186.224, Time=5.53 sec
 ARIMA(0,2,4)(0,1,0)[24]             : AIC=-188.647, Time=0.41 sec
 ARIMA(0,2,4)(0,1,1)[24]             : AIC=-180.194, Time=2.37 sec
 ARIMA(0,2,4)(1,1,0)[24]             : AIC=-182.898, Time=2.17 sec
 ARIMA(0,2,5)(0,1,0)[24]             : AIC=-189.343, Time=0.46 sec
 ARIMA(1,2,0)(0,1,0)[24]             : AIC=-195.053, Time=0.05 sec
 ARIMA(1,2,0)(0,1,1)[24]             : AIC=-193.053, Time=0.57 sec
 ARIMA(1,2,0)(0,1,2)[24]             : AIC=-191.053, Time=1.88 sec
 ARIMA(1,2,0)(1,1,0)[24]             : AIC=-193.052, Time=0.51 sec
 ARIMA(1,2,0)(1,1,1)[24]             : AIC=-191.053, Time=0.80 sec
 ARIMA(1,2,0)(1,1,2)[24]             : AIC=-189.053, Time=0.62 sec
 ARIMA(1,2,0)(2,1,0)[24]             : AIC=-191.053, Time=0.84 sec
 ARIMA(1,2,0)(2,1,1)[24]             : AIC=-189.053, Time=1.76 sec
 ARIMA(1,2,0)(2,1,2)[24]             : AIC=-187.053, Time=0.87 sec
 ARIMA(1,2,1)(0,1,0)[24]             : AIC=-193.489, Time=0.09 sec
 ARIMA(1,2,1)(0,1,1)[24]             : AIC=-191.489, Time=0.80 sec
 ARIMA(1,2,1)(0,1,2)[24]             : AIC=-189.489, Time=3.10 sec
 ARIMA(1,2,1)(1,1,0)[24]             : AIC=-191.487, Time=0.69 sec
 ARIMA(1,2,1)(1,1,1)[24]             : AIC=-189.489, Time=0.75 sec
 ARIMA(1,2,1)(1,1,2)[24]             : AIC=-187.489, Time=2.23 sec
 ARIMA(1,2,1)(2,1,0)[24]             : AIC=-189.489, Time=0.68 sec
 ARIMA(1,2,1)(2,1,1)[24]             : AIC=-187.489, Time=1.10 sec
 ARIMA(1,2,2)(0,1,0)[24]             : AIC=-191.441, Time=0.34 sec
 ARIMA(1,2,2)(0,1,1)[24]             : AIC=-187.999, Time=0.66 sec
 ARIMA(1,2,2)(0,1,2)[24]             : AIC=-187.375, Time=4.08 sec
 ARIMA(1,2,2)(1,1,0)[24]             : AIC=-190.342, Time=1.14 sec
 ARIMA(1,2,2)(1,1,1)[24]             : AIC=-188.065, Time=1.96 sec
 ARIMA(1,2,2)(2,1,0)[24]             : AIC=-186.000, Time=1.54 sec
 ARIMA(1,2,3)(0,1,0)[24]             : AIC=-188.443, Time=0.44 sec
 ARIMA(1,2,3)(0,1,1)[24]             : AIC=-187.062, Time=1.85 sec
 ARIMA(1,2,3)(1,1,0)[24]             : AIC=-187.684, Time=2.19 sec
 ARIMA(1,2,4)(0,1,0)[24]             : AIC=-188.969, Time=0.61 sec
 ARIMA(2,2,0)(0,1,0)[24]             : AIC=-193.225, Time=0.08 sec
 ARIMA(2,2,0)(0,1,1)[24]             : AIC=-191.225, Time=1.08 sec
 ARIMA(2,2,0)(0,1,2)[24]             : AIC=-189.225, Time=1.36 sec
 ARIMA(2,2,0)(1,1,0)[24]             : AIC=-191.224, Time=0.81 sec
 ARIMA(2,2,0)(1,1,1)[24]             : AIC=-189.225, Time=0.55 sec
 ARIMA(2,2,0)(1,1,2)[24]             : AIC=-187.225, Time=4.19 sec
 ARIMA(2,2,0)(2,1,0)[24]             : AIC=-189.225, Time=2.24 sec
 ARIMA(2,2,0)(2,1,1)[24]             : AIC=-187.225, Time=4.04 sec
 ARIMA(2,2,1)(0,1,0)[24]             : AIC=-190.989, Time=0.20 sec
 ARIMA(2,2,1)(0,1,1)[24]             : AIC=-186.536, Time=1.31 sec
 ARIMA(2,2,1)(0,1,2)[24]             : AIC=-187.096, Time=4.56 sec
 ARIMA(2,2,1)(1,1,0)[24]             : AIC=-189.129, Time=0.92 sec
 ARIMA(2,2,1)(1,1,1)[24]             : AIC=-187.126, Time=1.77 sec
 ARIMA(2,2,1)(2,1,0)[24]             : AIC=-187.028, Time=5.06 sec
 ARIMA(2,2,2)(0,1,0)[24]             : AIC=-188.850, Time=0.34 sec
 ARIMA(2,2,2)(0,1,1)[24]             : AIC=-186.863, Time=1.74 sec
 ARIMA(2,2,2)(1,1,0)[24]             : AIC=-186.721, Time=1.93 sec
 ARIMA(2,2,3)(0,1,0)[24]             : AIC=-188.137, Time=0.65 sec
 ARIMA(3,2,0)(0,1,0)[24]             : AIC=-192.075, Time=0.12 sec
 ARIMA(3,2,0)(0,1,1)[24]             : AIC=-190.074, Time=0.56 sec
 ARIMA(3,2,0)(0,1,2)[24]             : AIC=-188.074, Time=2.96 sec
 ARIMA(3,2,0)(1,1,0)[24]             : AIC=-190.073, Time=1.02 sec
 ARIMA(3,2,0)(1,1,1)[24]             : AIC=-188.075, Time=1.08 sec
 ARIMA(3,2,0)(2,1,0)[24]             : AIC=-188.074, Time=2.82 sec
 ARIMA(3,2,1)(0,1,0)[24]             : AIC=-189.918, Time=0.19 sec
 ARIMA(3,2,1)(0,1,1)[24]             : AIC=-187.918, Time=0.97 sec
 ARIMA(3,2,1)(1,1,0)[24]             : AIC=-187.916, Time=0.81 sec
 ARIMA(3,2,2)(0,1,0)[24]             : AIC=-187.715, Time=0.60 sec
 ARIMA(4,2,0)(0,1,0)[24]             : AIC=-188.949, Time=0.28 sec
 ARIMA(4,2,0)(0,1,1)[24]             : AIC=-186.948, Time=0.89 sec
 ARIMA(4,2,0)(1,1,0)[24]             : AIC=-186.947, Time=0.36 sec
 ARIMA(4,2,1)(0,1,0)[24]             : AIC=-188.558, Time=0.39 sec
 ARIMA(5,2,0)(0,1,0)[24]             : AIC=-187.118, Time=0.33 sec

Best model:  ARIMA(1,2,0)(0,1,0)[24]          
Total fit time: 144.842 seconds
                                     SARIMAX Results                                      
==========================================================================================
Dep. Variable:                                  y   No. Observations:                   56
Model:             SARIMAX(1, 2, 0)x(0, 1, 0, 24)   Log Likelihood                  99.526
Date:                            Mon, 27 Nov 2023   AIC                           -195.053
Time:                                    14:27:54   BIC                           -192.251
Sample:                                11-03-2021   HQIC                          -194.156
                                     - 11-23-2022                                         
Covariance Type:                              opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1         -0.2918      0.131     -2.225      0.026      -0.549      -0.035
sigma2      7.668e-05   1.94e-05      3.952      0.000    3.86e-05       0.000
===================================================================================
Ljung-Box (L1) (Q):                   0.21   Jarque-Bera (JB):                 3.65
Prob(Q):                              0.65   Prob(JB):                         0.16
Heteroskedasticity (H):               0.02   Skew:                            -0.59
Prob(H) (two-sided):                  0.00   Kurtosis:                         4.24
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: -195.05298526166553

Code

# Train results
train_pred = model.predict_in_sample()
# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")

Train RMSE: 0.014362240167989263
Test RMSE: 0.030781744659889882

Oddly enough, the test RMSE is much higher than that of the manually trained ARIMA model.

Because of this unordinary result, I wanted to employ cross validation techniques to see if I could get more standard results. I defined a time series cross-validation function (time_series_cv) to take the dataset, three cross validation splits, and a horizon which is the number of time steps ahead for which I will forecast and evaluate the model during each fold of the cross-validation process (essentially the size of the fold). The dataset is split based on the length of each segment with one segment used for testing and the rest for training. The loop runs for each split, incrementing the training dataset and testing the next segment. Then, auto_arima fits the model to the training data trying different combinations of parameters. Finally, test predictions are made.

I was unable to do the same configuration as my best model because when I set D = 1 and m=24, I get an error saying the values are too high because my dataset is so small. There are not enough observations in each fold to accommodate for those parameters. Therefore, for illustrative purposes, I chose to cross validate with D=0 to show that I achieved pretty similar results although the validated RMSE is only slightly higher.

Code

# Time Series Cross-Validation
def time_series_cv(data, n_splits, horizon):
    tscv_results = []
    split_length = int(len(data) / (n_splits + 1))

    for i in range(n_splits):
        train = data[:split_length*(i+1)]
        test = data[split_length*(i+1):split_length*(i+1) + horizon]

        model = auto_arima(train, start_p=0, start_q=0, max_p=7, max_q=7, m=24,start_P=0, seasonal=True, d=2, D = 0, trace=True,
                        error_action='ignore', suppress_warnings=True, stepwise=False)

        test_pred = model.predict(n_periods=horizon)
        rmse = np.sqrt(mean_squared_error(test, test_pred))
        tscv_results.append(rmse)

    return np.mean(tscv_results)

# Runing Time Series Cross-Validation
cv_rmse = time_series_cv(df_scaled, n_splits=3, horizon=13)
print(f"Average RMSE from Time Series Cross-Validation: {cv_rmse}")

 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-111.506, Time=0.02 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-109.506, Time=0.08 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-107.506, Time=0.13 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-109.506, Time=0.09 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-107.506, Time=0.22 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-105.506, Time=0.16 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-107.506, Time=0.32 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-105.506, Time=0.26 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-103.506, Time=0.26 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-109.886, Time=0.02 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-107.886, Time=0.07 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-105.886, Time=0.09 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-107.886, Time=0.03 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-105.886, Time=0.06 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-103.886, Time=0.17 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-105.886, Time=0.30 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-103.886, Time=0.54 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-101.886, Time=0.39 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-107.905, Time=0.03 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-105.908, Time=0.12 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-103.908, Time=0.68 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-105.908, Time=0.42 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-103.908, Time=0.23 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-101.908, Time=0.47 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-103.907, Time=0.62 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-101.901, Time=0.62 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-106.025, Time=0.05 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-104.026, Time=0.17 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-102.026, Time=0.45 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-104.025, Time=0.21 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-102.025, Time=0.47 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-102.022, Time=0.37 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-103.858, Time=0.09 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-103.844, Time=0.39 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-105.344, Time=0.23 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-107.828, Time=0.10 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-109.918, Time=0.01 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-107.918, Time=0.15 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-105.918, Time=0.20 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-107.918, Time=0.07 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-105.918, Time=0.08 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-103.918, Time=0.12 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-105.918, Time=0.40 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-103.918, Time=0.15 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-101.918, Time=0.13 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-107.925, Time=0.03 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-105.925, Time=0.04 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-103.925, Time=0.26 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-105.925, Time=0.09 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-103.925, Time=0.04 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-101.925, Time=0.27 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-103.925, Time=0.31 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-101.925, Time=0.19 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-106.651, Time=0.08 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=-104.647, Time=0.45 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=-102.649, Time=0.80 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=-104.657, Time=0.22 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-101.301, Time=0.24 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-102.657, Time=0.74 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-104.269, Time=0.09 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-102.263, Time=0.40 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-102.275, Time=0.23 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-102.463, Time=0.14 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-107.934, Time=0.02 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-105.934, Time=0.20 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-103.934, Time=0.24 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-105.934, Time=0.63 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-103.934, Time=0.07 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-101.934, Time=0.20 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-103.934, Time=0.29 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-101.934, Time=0.39 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-105.928, Time=0.03 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-103.928, Time=0.06 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-101.928, Time=0.49 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-103.927, Time=0.16 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-101.928, Time=0.34 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-101.928, Time=0.50 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-104.137, Time=0.03 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-102.140, Time=0.48 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-102.096, Time=0.32 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-103.216, Time=0.07 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-106.150, Time=0.03 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-104.150, Time=0.39 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-102.150, Time=0.56 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-104.150, Time=0.23 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-102.150, Time=0.27 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-102.150, Time=0.42 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-104.097, Time=0.03 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-102.097, Time=0.07 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-102.097, Time=0.06 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-102.619, Time=0.06 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-105.296, Time=0.08 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-103.306, Time=0.56 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-103.045, Time=0.15 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-104.200, Time=0.05 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-105.008, Time=0.10 sec

Best model:  ARIMA(0,2,0)(0,0,0)[24]          
Total fit time: 22.471 seconds
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-254.625, Time=0.01 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-252.625, Time=0.22 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-250.625, Time=0.36 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-252.644, Time=0.04 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-250.625, Time=0.16 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-248.625, Time=0.25 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-250.625, Time=0.44 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-248.625, Time=0.67 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-246.625, Time=0.37 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-254.995, Time=0.01 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-252.995, Time=0.05 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-250.995, Time=0.09 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-253.025, Time=0.03 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-250.995, Time=0.13 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-248.995, Time=0.32 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-250.995, Time=0.17 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-248.995, Time=0.37 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-246.995, Time=0.28 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-253.044, Time=0.07 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-251.082, Time=0.22 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-249.053, Time=0.69 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-251.082, Time=0.22 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-249.062, Time=0.08 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-247.062, Time=0.34 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-249.072, Time=0.60 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-247.062, Time=0.32 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-251.043, Time=0.07 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-248.940, Time=0.06 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-246.940, Time=0.25 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-249.085, Time=0.45 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-247.037, Time=0.29 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-247.054, Time=1.75 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-256.603, Time=0.11 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-252.601, Time=0.31 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-254.529, Time=0.37 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-256.325, Time=0.09 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-255.032, Time=0.01 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-253.032, Time=0.08 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-251.032, Time=0.17 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-253.070, Time=0.17 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-251.032, Time=0.13 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-249.032, Time=0.29 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-251.032, Time=0.51 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-249.032, Time=0.48 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-247.032, Time=0.61 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-253.027, Time=0.04 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-251.027, Time=0.12 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-249.027, Time=0.55 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-251.058, Time=0.16 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-249.027, Time=0.13 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-247.027, Time=0.18 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-249.027, Time=0.77 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-247.027, Time=0.19 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=-251.014, Time=0.04 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=-249.084, Time=0.43 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=-247.080, Time=1.05 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=-249.088, Time=0.35 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=-247.029, Time=0.40 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=-247.095, Time=1.36 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-253.394, Time=0.07 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-251.960, Time=0.39 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-251.053, Time=0.61 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-254.680, Time=0.09 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-253.040, Time=0.04 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-251.082, Time=0.52 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-249.081, Time=0.57 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-251.076, Time=0.07 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-249.085, Time=0.14 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-247.085, Time=0.41 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-249.084, Time=0.64 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-247.085, Time=0.53 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-251.039, Time=0.04 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-249.072, Time=0.10 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-247.096, Time=1.49 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-249.080, Time=0.15 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-247.070, Time=0.28 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-247.065, Time=1.35 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-249.053, Time=0.05 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-247.089, Time=0.15 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-247.089, Time=0.27 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-249.552, Time=0.07 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-251.357, Time=0.02 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-249.357, Time=0.10 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-247.357, Time=0.37 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-249.401, Time=0.16 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-247.357, Time=0.09 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-247.357, Time=0.61 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-249.191, Time=0.02 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-247.191, Time=0.10 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-247.236, Time=0.30 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-247.212, Time=0.05 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-250.547, Time=0.07 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-248.583, Time=0.45 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-248.438, Time=0.22 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-249.292, Time=0.10 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-251.810, Time=0.08 sec

Best model:  ARIMA(0,2,4)(0,0,0)[24]          
Total fit time: 29.310 seconds
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-413.858, Time=0.02 sec
 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-411.858, Time=0.10 sec
 ARIMA(0,2,0)(0,0,2)[24]             : AIC=-409.858, Time=0.22 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-411.905, Time=0.18 sec
 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-409.858, Time=0.12 sec
 ARIMA(0,2,0)(1,0,2)[24]             : AIC=-407.858, Time=0.31 sec
 ARIMA(0,2,0)(2,0,0)[24]             : AIC=-409.908, Time=0.57 sec
 ARIMA(0,2,0)(2,0,1)[24]             : AIC=-407.858, Time=0.35 sec
 ARIMA(0,2,0)(2,0,2)[24]             : AIC=-405.858, Time=0.47 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-415.520, Time=0.01 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-413.608, Time=0.38 sec
 ARIMA(0,2,1)(0,0,2)[24]             : AIC=-411.607, Time=0.57 sec
 ARIMA(0,2,1)(1,0,0)[24]             : AIC=-413.584, Time=0.29 sec
 ARIMA(0,2,1)(1,0,1)[24]             : AIC=-411.605, Time=0.10 sec
 ARIMA(0,2,1)(1,0,2)[24]             : AIC=-409.606, Time=0.96 sec
 ARIMA(0,2,1)(2,0,0)[24]             : AIC=-411.592, Time=0.51 sec
 ARIMA(0,2,1)(2,0,1)[24]             : AIC=-409.605, Time=0.74 sec
 ARIMA(0,2,1)(2,0,2)[24]             : AIC=-407.607, Time=0.49 sec
 ARIMA(0,2,2)(0,0,0)[24]             : AIC=-413.571, Time=0.04 sec
 ARIMA(0,2,2)(0,0,1)[24]             : AIC=-411.676, Time=0.37 sec
 ARIMA(0,2,2)(0,0,2)[24]             : AIC=-409.650, Time=0.50 sec
 ARIMA(0,2,2)(1,0,0)[24]             : AIC=-411.661, Time=0.72 sec
 ARIMA(0,2,2)(1,0,1)[24]             : AIC=-409.672, Time=0.27 sec
 ARIMA(0,2,2)(1,0,2)[24]             : AIC=-407.675, Time=0.85 sec
 ARIMA(0,2,2)(2,0,0)[24]             : AIC=-409.691, Time=1.10 sec
 ARIMA(0,2,2)(2,0,1)[24]             : AIC=-407.693, Time=2.01 sec
 ARIMA(0,2,3)(0,0,0)[24]             : AIC=-411.622, Time=0.13 sec
 ARIMA(0,2,3)(0,0,1)[24]             : AIC=-409.619, Time=0.32 sec
 ARIMA(0,2,3)(0,0,2)[24]             : AIC=-407.619, Time=1.34 sec
 ARIMA(0,2,3)(1,0,0)[24]             : AIC=-409.626, Time=0.24 sec
 ARIMA(0,2,3)(1,0,1)[24]             : AIC=-407.636, Time=0.26 sec
 ARIMA(0,2,3)(2,0,0)[24]             : AIC=-407.662, Time=1.25 sec
 ARIMA(0,2,4)(0,0,0)[24]             : AIC=-420.570, Time=0.12 sec
 ARIMA(0,2,4)(0,0,1)[24]             : AIC=-418.339, Time=0.40 sec
 ARIMA(0,2,4)(1,0,0)[24]             : AIC=-414.645, Time=0.38 sec
 ARIMA(0,2,5)(0,0,0)[24]             : AIC=-419.867, Time=0.11 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-415.574, Time=0.02 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-413.574, Time=0.16 sec
 ARIMA(1,2,0)(0,0,2)[24]             : AIC=-411.574, Time=0.42 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-413.654, Time=0.06 sec
 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-411.574, Time=0.15 sec
 ARIMA(1,2,0)(1,0,2)[24]             : AIC=-409.574, Time=0.34 sec
 ARIMA(1,2,0)(2,0,0)[24]             : AIC=-411.665, Time=0.44 sec
 ARIMA(1,2,0)(2,0,1)[24]             : AIC=-409.574, Time=0.50 sec
 ARIMA(1,2,0)(2,0,2)[24]             : AIC=-407.574, Time=0.64 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-413.564, Time=0.02 sec
 ARIMA(1,2,1)(0,0,1)[24]             : AIC=-411.675, Time=0.16 sec
 ARIMA(1,2,1)(0,0,2)[24]             : AIC=-409.564, Time=0.34 sec
 ARIMA(1,2,1)(1,0,0)[24]             : AIC=-411.661, Time=0.10 sec
 ARIMA(1,2,1)(1,0,1)[24]             : AIC=-409.664, Time=0.15 sec
 ARIMA(1,2,1)(1,0,2)[24]             : AIC=-407.664, Time=0.57 sec
 ARIMA(1,2,1)(2,0,0)[24]             : AIC=-409.661, Time=1.07 sec
 ARIMA(1,2,1)(2,0,1)[24]             : AIC=-407.664, Time=0.67 sec
 ARIMA(1,2,2)(0,0,0)[24]             : AIC=inf, Time=0.08 sec
 ARIMA(1,2,2)(0,0,1)[24]             : AIC=inf, Time=0.42 sec
 ARIMA(1,2,2)(0,0,2)[24]             : AIC=inf, Time=1.77 sec
 ARIMA(1,2,2)(1,0,0)[24]             : AIC=inf, Time=0.38 sec
 ARIMA(1,2,2)(1,0,1)[24]             : AIC=inf, Time=0.79 sec
 ARIMA(1,2,2)(2,0,0)[24]             : AIC=inf, Time=2.76 sec
 ARIMA(1,2,3)(0,0,0)[24]             : AIC=-416.675, Time=0.09 sec
 ARIMA(1,2,3)(0,0,1)[24]             : AIC=-408.325, Time=0.15 sec
 ARIMA(1,2,3)(1,0,0)[24]             : AIC=-414.451, Time=0.60 sec
 ARIMA(1,2,4)(0,0,0)[24]             : AIC=-416.283, Time=0.11 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-413.587, Time=0.02 sec
 ARIMA(2,2,0)(0,0,1)[24]             : AIC=-411.587, Time=0.10 sec
 ARIMA(2,2,0)(0,0,2)[24]             : AIC=-409.587, Time=0.15 sec
 ARIMA(2,2,0)(1,0,0)[24]             : AIC=-411.663, Time=0.06 sec
 ARIMA(2,2,0)(1,0,1)[24]             : AIC=-409.587, Time=0.05 sec
 ARIMA(2,2,0)(1,0,2)[24]             : AIC=-407.587, Time=0.44 sec
 ARIMA(2,2,0)(2,0,0)[24]             : AIC=-409.673, Time=0.38 sec
 ARIMA(2,2,0)(2,0,1)[24]             : AIC=-407.587, Time=0.68 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-411.598, Time=0.06 sec
 ARIMA(2,2,1)(0,0,1)[24]             : AIC=-409.639, Time=0.22 sec
 ARIMA(2,2,1)(0,0,2)[24]             : AIC=-407.718, Time=1.06 sec
 ARIMA(2,2,1)(1,0,0)[24]             : AIC=-409.677, Time=0.18 sec
 ARIMA(2,2,1)(1,0,1)[24]             : AIC=-407.714, Time=0.30 sec
 ARIMA(2,2,1)(2,0,0)[24]             : AIC=-407.710, Time=1.63 sec
 ARIMA(2,2,2)(0,0,0)[24]             : AIC=-409.605, Time=0.06 sec
 ARIMA(2,2,2)(0,0,1)[24]             : AIC=-407.691, Time=0.26 sec
 ARIMA(2,2,2)(1,0,0)[24]             : AIC=-407.704, Time=0.30 sec
 ARIMA(2,2,3)(0,0,0)[24]             : AIC=-408.342, Time=0.05 sec
 ARIMA(3,2,0)(0,0,0)[24]             : AIC=-412.067, Time=0.02 sec
 ARIMA(3,2,0)(0,0,1)[24]             : AIC=-410.067, Time=0.12 sec
 ARIMA(3,2,0)(0,0,2)[24]             : AIC=-408.067, Time=0.19 sec
 ARIMA(3,2,0)(1,0,0)[24]             : AIC=-410.155, Time=0.19 sec
 ARIMA(3,2,0)(1,0,1)[24]             : AIC=-408.067, Time=0.34 sec
 ARIMA(3,2,0)(2,0,0)[24]             : AIC=-408.167, Time=0.23 sec
 ARIMA(3,2,1)(0,0,0)[24]             : AIC=-409.934, Time=0.08 sec
 ARIMA(3,2,1)(0,0,1)[24]             : AIC=-407.819, Time=0.21 sec
 ARIMA(3,2,1)(1,0,0)[24]             : AIC=-407.909, Time=0.16 sec
 ARIMA(3,2,2)(0,0,0)[24]             : AIC=-407.940, Time=0.14 sec
 ARIMA(4,2,0)(0,0,0)[24]             : AIC=-411.810, Time=0.06 sec
 ARIMA(4,2,0)(0,0,1)[24]             : AIC=-410.094, Time=0.35 sec
 ARIMA(4,2,0)(1,0,0)[24]             : AIC=-410.113, Time=0.40 sec
 ARIMA(4,2,1)(0,0,0)[24]             : AIC=-411.343, Time=0.05 sec
 ARIMA(5,2,0)(0,0,0)[24]             : AIC=-413.795, Time=0.04 sec

Best model:  ARIMA(0,2,4)(0,0,0)[24]          
Total fit time: 38.422 seconds
Average RMSE from Time Series Cross-Validation: 0.030806369395818062

Through auto_arima, the parameters that achieved the best results in terms of RMSE are ARIMA(1,2,0)(0,1,0)[24]. The meanings of these parameters are as follows:

Non-seasonal

1 (p): The model uses the past one observation to predict the current value (number of autoregressive terms).

2 (d): The data has been differenced twice to make it stationary (the degree of differencing).

0 (q): The model does not use past forecast errors in predicting future values (number of moving average terms).

Seasonal

0 (P): The model does not use past seasonal observations in predicting the current value (number of seasonal autoregressive terms).

1 (D): Data are seasonally differenced once (degree of seasonal differencing).

0 (Q): The model does not use past seasonal forecast errors to predict future values (number of seasonal moving average terms).

1.3.2.3 3. Model Performance

In comparing this model to the manual ARIMA model I previously created, it shows a different set of optimal parameters. While the manual ARIMA model was (0,1,6) without seasonality and produced a test RMSE of 0.009937797182224015, the best auto_arima model, ARIMA(1,2,0)(0,1,0)24, yielded a test RMSE of 0.030781744659889882. The key difference lies in the seasonal component of ARIMA(1,2,0)(0,1,0)24, indicating a seasonal period of 24 weeks, compared to the non-seasonal ARIMA(0,1,6) model. The ARIMA(1,2,0) component uses one past observation for predictions and differs data twice for stationarity, while the ARIMA(0,1,6) model focuses more on short-term error correction with six MA terms.

The test RMSE of the auto_arima model is among the lowest I have created. The train RMSE is 0.014362240167989263. Upon examining the residual plot, the residuals hover around zero, and the variance remains fairly consistent, suggesting the model does not systematically over or underestimate the observed values.

Other model statistics, like the high log likelihood and low AIC, BIC, p-values, and sigma2, indicate a good fit. The Ljung-Box and Jarque-Bera tests show no significant autocorrelation and that residuals are normally distributed. However, there is a slight skew and high kurtosis, and evidence of heteroskedasticity indicates varying variance of residuals over time.

Overall, this model performs quite well despite some signs of heteroskedasticity.

Code

final_model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

# Residual Analysis
residuals = pd.Series(final_model.arima_res_.resid)
plt.figure(figsize=(12, 6))
plt.subplot(211)
plot_acf(residuals, ax=plt.gca())
plt.subplot(212)
plot_pacf(residuals, ax=plt.gca())
plt.show()

# Check if residuals have any patterns left
plt.figure()
residuals.plot(title="Residuals")
plt.show()

# Print final model summary
final_model.summary()

 ARIMA(0,2,0)(0,1,0)[24]             : AIC=-194.449, Time=0.06 sec
 ARIMA(0,2,0)(0,1,1)[24]             : AIC=-192.449, Time=0.52 sec
 ARIMA(0,2,0)(0,1,2)[24]             : AIC=-190.449, Time=2.14 sec
 ARIMA(0,2,0)(1,1,0)[24]             : AIC=-192.449, Time=0.22 sec
 ARIMA(0,2,0)(1,1,1)[24]             : AIC=-190.449, Time=0.51 sec
 ARIMA(0,2,0)(1,1,2)[24]             : AIC=-188.449, Time=2.44 sec
 ARIMA(0,2,0)(2,1,0)[24]             : AIC=-190.449, Time=1.38 sec
 ARIMA(0,2,0)(2,1,1)[24]             : AIC=-188.449, Time=1.84 sec
 ARIMA(0,2,0)(2,1,2)[24]             : AIC=-186.449, Time=1.73 sec
 ARIMA(0,2,1)(0,1,0)[24]             : AIC=-194.685, Time=0.10 sec
 ARIMA(0,2,1)(0,1,1)[24]             : AIC=-192.685, Time=0.57 sec
 ARIMA(0,2,1)(0,1,2)[24]             : AIC=-190.685, Time=1.50 sec
 ARIMA(0,2,1)(1,1,0)[24]             : AIC=-192.685, Time=0.83 sec
 ARIMA(0,2,1)(1,1,1)[24]             : AIC=-190.685, Time=0.93 sec
 ARIMA(0,2,1)(1,1,2)[24]             : AIC=-188.685, Time=2.14 sec
 ARIMA(0,2,1)(2,1,0)[24]             : AIC=-190.685, Time=2.53 sec
 ARIMA(0,2,1)(2,1,1)[24]             : AIC=-188.685, Time=2.37 sec
 ARIMA(0,2,1)(2,1,2)[24]             : AIC=-186.685, Time=4.32 sec
 ARIMA(0,2,2)(0,1,0)[24]             : AIC=-192.580, Time=0.32 sec
 ARIMA(0,2,2)(0,1,1)[24]             : AIC=-189.234, Time=1.71 sec
 ARIMA(0,2,2)(0,1,2)[24]             : AIC=-187.018, Time=7.61 sec
 ARIMA(0,2,2)(1,1,0)[24]             : AIC=-190.381, Time=1.47 sec
 ARIMA(0,2,2)(1,1,1)[24]             : AIC=-188.156, Time=2.84 sec
 ARIMA(0,2,2)(1,1,2)[24]             : AIC=-184.976, Time=3.19 sec
 ARIMA(0,2,2)(2,1,0)[24]             : AIC=-187.285, Time=7.37 sec
 ARIMA(0,2,2)(2,1,1)[24]             : AIC=-184.977, Time=2.80 sec
 ARIMA(0,2,3)(0,1,0)[24]             : AIC=-190.595, Time=0.32 sec
 ARIMA(0,2,3)(0,1,1)[24]             : AIC=-189.068, Time=2.20 sec
 ARIMA(0,2,3)(0,1,2)[24]             : AIC=-187.340, Time=3.20 sec
 ARIMA(0,2,3)(1,1,0)[24]             : AIC=-188.505, Time=1.38 sec
 ARIMA(0,2,3)(1,1,1)[24]             : AIC=-187.171, Time=2.26 sec
 ARIMA(0,2,3)(2,1,0)[24]             : AIC=-186.224, Time=5.98 sec
 ARIMA(0,2,4)(0,1,0)[24]             : AIC=-188.647, Time=0.41 sec
 ARIMA(0,2,4)(0,1,1)[24]             : AIC=-180.194, Time=2.60 sec
 ARIMA(0,2,4)(1,1,0)[24]             : AIC=-182.898, Time=1.57 sec
 ARIMA(0,2,5)(0,1,0)[24]             : AIC=-189.343, Time=0.51 sec
 ARIMA(1,2,0)(0,1,0)[24]             : AIC=-195.053, Time=0.06 sec
 ARIMA(1,2,0)(0,1,1)[24]             : AIC=-193.053, Time=0.47 sec
 ARIMA(1,2,0)(0,1,2)[24]             : AIC=-191.053, Time=1.37 sec
 ARIMA(1,2,0)(1,1,0)[24]             : AIC=-193.052, Time=0.39 sec
 ARIMA(1,2,0)(1,1,1)[24]             : AIC=-191.053, Time=0.75 sec
 ARIMA(1,2,0)(1,1,2)[24]             : AIC=-189.053, Time=0.55 sec
 ARIMA(1,2,0)(2,1,0)[24]             : AIC=-191.053, Time=0.75 sec
 ARIMA(1,2,0)(2,1,1)[24]             : AIC=-189.053, Time=1.63 sec
 ARIMA(1,2,0)(2,1,2)[24]             : AIC=-187.053, Time=0.74 sec
 ARIMA(1,2,1)(0,1,0)[24]             : AIC=-193.489, Time=0.12 sec
 ARIMA(1,2,1)(0,1,1)[24]             : AIC=-191.489, Time=0.71 sec
 ARIMA(1,2,1)(0,1,2)[24]             : AIC=-189.489, Time=3.02 sec
 ARIMA(1,2,1)(1,1,0)[24]             : AIC=-191.487, Time=0.70 sec
 ARIMA(1,2,1)(1,1,1)[24]             : AIC=-189.489, Time=0.75 sec
 ARIMA(1,2,1)(1,1,2)[24]             : AIC=-187.489, Time=2.13 sec
 ARIMA(1,2,1)(2,1,0)[24]             : AIC=-189.489, Time=0.77 sec
 ARIMA(1,2,1)(2,1,1)[24]             : AIC=-187.489, Time=1.12 sec
 ARIMA(1,2,2)(0,1,0)[24]             : AIC=-191.441, Time=0.36 sec
 ARIMA(1,2,2)(0,1,1)[24]             : AIC=-187.999, Time=0.63 sec
 ARIMA(1,2,2)(0,1,2)[24]             : AIC=-187.375, Time=4.15 sec
 ARIMA(1,2,2)(1,1,0)[24]             : AIC=-190.342, Time=1.28 sec
 ARIMA(1,2,2)(1,1,1)[24]             : AIC=-188.065, Time=1.93 sec
 ARIMA(1,2,2)(2,1,0)[24]             : AIC=-186.000, Time=1.46 sec
 ARIMA(1,2,3)(0,1,0)[24]             : AIC=-188.443, Time=0.42 sec
 ARIMA(1,2,3)(0,1,1)[24]             : AIC=-187.062, Time=1.82 sec
 ARIMA(1,2,3)(1,1,0)[24]             : AIC=-187.684, Time=2.51 sec
 ARIMA(1,2,4)(0,1,0)[24]             : AIC=-188.969, Time=0.61 sec
 ARIMA(2,2,0)(0,1,0)[24]             : AIC=-193.225, Time=0.08 sec
 ARIMA(2,2,0)(0,1,1)[24]             : AIC=-191.225, Time=1.02 sec
 ARIMA(2,2,0)(0,1,2)[24]             : AIC=-189.225, Time=1.57 sec
 ARIMA(2,2,0)(1,1,0)[24]             : AIC=-191.224, Time=0.85 sec
 ARIMA(2,2,0)(1,1,1)[24]             : AIC=-189.225, Time=0.69 sec
 ARIMA(2,2,0)(1,1,2)[24]             : AIC=-187.225, Time=4.22 sec
 ARIMA(2,2,0)(2,1,0)[24]             : AIC=-189.225, Time=2.36 sec
 ARIMA(2,2,0)(2,1,1)[24]             : AIC=-187.225, Time=4.23 sec
 ARIMA(2,2,1)(0,1,0)[24]             : AIC=-190.989, Time=0.19 sec
 ARIMA(2,2,1)(0,1,1)[24]             : AIC=-186.536, Time=1.07 sec
 ARIMA(2,2,1)(0,1,2)[24]             : AIC=-187.096, Time=4.19 sec
 ARIMA(2,2,1)(1,1,0)[24]             : AIC=-189.129, Time=0.98 sec
 ARIMA(2,2,1)(1,1,1)[24]             : AIC=-187.126, Time=1.64 sec
 ARIMA(2,2,1)(2,1,0)[24]             : AIC=-187.028, Time=4.51 sec
 ARIMA(2,2,2)(0,1,0)[24]             : AIC=-188.850, Time=0.34 sec
 ARIMA(2,2,2)(0,1,1)[24]             : AIC=-186.863, Time=1.93 sec
 ARIMA(2,2,2)(1,1,0)[24]             : AIC=-186.721, Time=1.45 sec
 ARIMA(2,2,3)(0,1,0)[24]             : AIC=-188.137, Time=0.66 sec
 ARIMA(3,2,0)(0,1,0)[24]             : AIC=-192.075, Time=0.12 sec
 ARIMA(3,2,0)(0,1,1)[24]             : AIC=-190.074, Time=0.55 sec
 ARIMA(3,2,0)(0,1,2)[24]             : AIC=-188.074, Time=3.18 sec
 ARIMA(3,2,0)(1,1,0)[24]             : AIC=-190.073, Time=0.94 sec
 ARIMA(3,2,0)(1,1,1)[24]             : AIC=-188.075, Time=1.19 sec
 ARIMA(3,2,0)(2,1,0)[24]             : AIC=-188.074, Time=2.82 sec
 ARIMA(3,2,1)(0,1,0)[24]             : AIC=-189.918, Time=0.19 sec
 ARIMA(3,2,1)(0,1,1)[24]             : AIC=-187.918, Time=1.14 sec
 ARIMA(3,2,1)(1,1,0)[24]             : AIC=-187.916, Time=0.73 sec
 ARIMA(3,2,2)(0,1,0)[24]             : AIC=-187.715, Time=0.57 sec
 ARIMA(4,2,0)(0,1,0)[24]             : AIC=-188.949, Time=0.28 sec
 ARIMA(4,2,0)(0,1,1)[24]             : AIC=-186.948, Time=0.99 sec
 ARIMA(4,2,0)(1,1,0)[24]             : AIC=-186.947, Time=0.38 sec
 ARIMA(4,2,1)(0,1,0)[24]             : AIC=-188.558, Time=0.35 sec
 ARIMA(5,2,0)(0,1,0)[24]             : AIC=-187.118, Time=0.34 sec

Best model:  ARIMA(1,2,0)(0,1,0)[24]          
Total fit time: 150.839 seconds

SARIMAX Results

Dep. Variable:	y	No. Observations:	56
Model:	SARIMAX(1, 2, 0)x(0, 1, 0, 24)	Log Likelihood	99.526
Date:	Mon, 27 Nov 2023	AIC	-195.053
Time:	15:12:33	BIC	-192.251
Sample:	11-03-2021	HQIC	-194.156
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
ar.L1	-0.2918	0.131	-2.225	0.026	-0.549	-0.035
sigma2	7.668e-05	1.94e-05	3.952	0.000	3.86e-05	0.000

Ljung-Box (L1) (Q):	0.21	Jarque-Bera (JB):	3.65
Prob(Q):	0.65	Prob(JB):	0.16
Heteroskedasticity (H):	0.02	Skew:	-0.59
Prob(H) (two-sided):	0.00	Kurtosis:	4.24

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

Code

# Train results
train_pred = final_model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train_aar.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = final_model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")

Train RMSE: 0.014362240167989263
Test RMSE: 0.030781744659889882

1.3.3 C. Prophet (Univariate) Model

1.3.3.1 1. Data Preparation:

The Prophet model forecasts time series data using an additive approach. It’s particularly effective with data showing strong seasonal effects and handles inconsistencies like missing values and outliers well. Prophet’s model comprises three main components: trend (\(g(t)\)), seasonality (\(s(t)\)), and holidays (\(h(t)\)), along with an error term (\(e_t\)). The trend component adapts to changes in data, seasonality uses a Fourier Series to capture cyclical patterns, and the holiday component accounts for periodic events’ impacts.

Key parameters of Prophet include:

• growth: Specifies the trend type (linear or logistic).
• changepoint_num: Sets the maximum number of trend changepoints.
• changepoint_range: Determines how close changepoints can be to the end of the series, affecting model flexibility.
• Seasonality Settings:
  • Yearly (seasonality_yearly)
  • Weekly (seasonality_weekly)
  • Daily (seasonality_daily)
• season: Defines the seasonality type (additive or multiplicative).
• Prior Scale Parameters: These control the flexibility of changepoints (changepoint_prior_scale), seasonality (seasonality_prior_scale), and holidays (holidays_prior_scale).

For the univariate Prophet model, I prepared the data by importing the Date and response variable 'Additional_Doses_Vax_Pct' from my dataset. The data was grouped by Date to ensure one unique value per date. The DataFrame was structured with ds for dates (in YYYY-MM-DD format) and y for the response variable. Additionally, I scaled the data for consistency with other models in the analysis.

Code

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Import data with specific columns
df_p = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime and set as index
df_p['Date'] = pd.to_datetime(df_p['Date'])
df_p.set_index('Date', inplace=True)

# Group by 'Date' to ensure there is one unique value per date
df_p = df_p.groupby('Date').mean()

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_p[pred_var] = scaler.fit_transform(df_p[[pred_var]])

# 'Date' column as a separate variable
df_p.reset_index(inplace=True)

# Rename the columns for compatibility with Prophet
df_p.rename(columns={'Date': 'ds', pred_var: 'y'}, inplace=True)

1.3.3.2 2. Model Building:

As for the training for the Prophet univariate model, I first split my dataframe into train and test sets with a 70-30 train-test split. Then, for an initial base model, I simply fit the Prophet() model without modifying any of the parameters. The RMSE was relatively high, so I knew I could improve on my model.

Code

# Calculate the index for the 70-30 split
split_index = int(len(df_p) * 0.7)

# Split into train and test
train = df_p.iloc[:split_index]
test = df_p.iloc[split_index:]

# Initialize and fit the Prophet model on the training data
model = Prophet()
model.fit(train)

16:36:59 - cmdstanpy - INFO - Chain [1] start processing
16:36:59 - cmdstanpy - INFO - Chain [1] done processing

<prophet.forecaster.Prophet at 0x2e8a2cf50>

Code

# Make predictions on the training set
train_pred = model.predict(train[['ds']])

# Plot the training predictions
pd.concat([train['y'], train_pred['yhat']], axis=1).plot(figsize=(15,5))
plt.legend(['train', 'train_pred'])

# Make predictions on the test set
test_pred = model.predict(test[['ds']])

# Plot the test predictions
pd.concat([test['y'], test_pred['yhat']], axis=1).plot()
plt.legend(['test', 'test_pred'])
plt.show()
# Calculate RMSE for the training set
train_rmse = sqrt(mean_squared_error(train['y'], train_pred['yhat']))
print(f"Train RMSE: {train_rmse}")

# Calculate RMSE for the test set
test_rmse = sqrt(mean_squared_error(test['y'], test_pred['yhat']))
print(f"Test RMSE: {test_rmse}")

Train RMSE: 0.002906993025481394
Test RMSE: 0.022970901026062914

Next, I enhanced the Prophet model by adding cross-validation and incorporating U.S. holidays. This approach allows the model to account for the potential impact of holidays on vaccination trends. The model fitting process remained similar, but I now generated future data points for predictions, with a weekly frequency (freq = 'W'), to align with our data’s weekly reporting structure.

For cross-validation, I set specific parameters based on the data span (November 2021 to May 2023):

• Initial Training Period (initial): Set to ‘180 days’, giving the model a substantial initial dataset to understand any half-yearly seasonality.
• Update Frequency (period): Chosen as ‘45 days’, ensuring the model updates itself every month and a half to stay aligned with changing data patterns.
• Forecast Horizon (horizon): Fixed at ‘45 days’, balancing the need for near-future predictions while maintaining reasonable forecast accuracy.

These settings allowed me to evaluate the model’s performance across various simulated scenarios. Additionally, I graphically analyzed the model’s forecasts to understand how it interprets trends and seasonality.

The visual outputs indicated a consistent upward trend, aligning with the increasing cumulative nature of vaccination rates. Significantly, the model successfully captured the pronounced effects of holidays in late 2022 and early 2023 on vaccination rates.

Code

# Initialize Prophet model with US holidays
model = Prophet()
model.add_country_holidays(country_name='US')

# Fit model on the training data
model.fit(train)

# Predict on the test set with weekly frequency
future_test = model.make_future_dataframe(periods=len(test), include_history=False, freq='W')
forecast_test = model.predict(future_test)

# Calculate RMSE for the test set
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f'Test RMSE: {test_rmse}')

# Cross-validation using training data 
cv_results = cross_validation(model, initial='180 days', period='45 days', horizon='45 days')

# Calculate RMSE for cross-validation results
rmse_cv = sqrt(mean_squared_error(cv_results['y'], cv_results['yhat']))
print(f'Cross-Validation RMSE: {rmse_cv}')

# Plot the forecast on test data
fig = model.plot(forecast_test)
plt.show()

# Plot components
fig2 = model.plot_components(forecast_test)
plt.show()

16:37:09 - cmdstanpy - INFO - Chain [1] start processing
16:37:09 - cmdstanpy - INFO - Chain [1] done processing

Test RMSE: 0.021909128419629015

16:37:09 - cmdstanpy - INFO - Chain [1] start processing
16:37:09 - cmdstanpy - INFO - Chain [1] done processing
16:37:09 - cmdstanpy - INFO - Chain [1] start processing
16:37:09 - cmdstanpy - INFO - Chain [1] done processing
16:37:09 - cmdstanpy - INFO - Chain [1] start processing
16:37:10 - cmdstanpy - INFO - Chain [1] done processing
16:37:10 - cmdstanpy - INFO - Chain [1] start processing
16:37:10 - cmdstanpy - INFO - Chain [1] done processing

Cross-Validation RMSE: 0.183403907282513

Code

# Performance metrics
df_performance = performance_metrics(cv_results)
df_performance

	horizon	mse	rmse	mae	mape	mdape	smape	coverage
0	3 days	0.012509	0.111844	0.079656	0.088319	0.088319	0.081246	0.5
1	5 days	0.014979	0.122387	0.087111	0.101335	0.101335	0.092117	0.5
2	6 days	0.027961	0.167214	0.167107	0.187790	0.187790	0.171599	0.5
3	9 days	0.028462	0.168707	0.168544	0.184210	0.184210	0.168636	0.5
4	10 days	0.015481	0.124422	0.088867	0.098091	0.098091	0.089490	0.5
5	12 days	0.019008	0.137869	0.098376	0.113740	0.113740	0.102307	0.5
6	13 days	0.034707	0.186298	0.186086	0.208382	0.208382	0.188609	0.0
7	16 days	0.034400	0.185473	0.185297	0.201857	0.201857	0.183309	0.0
8	17 days	0.018706	0.136768	0.098404	0.108072	0.108072	0.097866	0.5
9	19 days	0.023495	0.153280	0.110081	0.126442	0.126442	0.112632	0.5
10	20 days	0.042114	0.205216	0.204873	0.228547	0.228547	0.204953	0.0
11	23 days	0.041149	0.202853	0.202624	0.220171	0.220171	0.198282	0.0
12	24 days	0.022540	0.150132	0.108881	0.119155	0.119155	0.107053	0.5
13	26 days	0.028736	0.169517	0.122592	0.140073	0.140073	0.123532	0.5
14	27 days	0.050368	0.224427	0.223870	0.248898	0.248898	0.221123	0.0
15	30 days	0.048272	0.219708	0.219415	0.237676	0.237676	0.212359	0.0
16	31 days	0.026649	0.163245	0.118840	0.129571	0.129571	0.115493	0.5
17	33 days	0.030138	0.173603	0.126168	0.140747	0.140747	0.124221	0.5
18	34 days	0.054933	0.234378	0.234105	0.256388	0.256388	0.227144	0.0
19	37 days	0.056011	0.236667	0.236283	0.255186	0.255186	0.226214	0.0
20	38 days	0.031222	0.176698	0.128741	0.139942	0.139942	0.123691	0.5
21	40 days	0.036291	0.190501	0.138506	0.153971	0.153971	0.134430	0.5
22	41 days	0.064124	0.253227	0.252681	0.275732	0.275732	0.242125	0.0
23	44 days	0.063789	0.252564	0.252057	0.271108	0.271108	0.238614	0.0
24	45 days	0.035969	0.189656	0.138681	0.150154	0.150154	0.131734	0.5

To refine the model, I first introduced a ‘cap’ feature, indicating the maximum achievable saturation point. This step is crucial for models with logistic growth in Prophet, as it helps define an upper limit for predictions. Observing the vaccination rate data, which initially rises rapidly before leveling off near 100%, I set growth = 'logistic' in the model to mirror this pattern.

Like before, I included U.S. holidays to account for their impact on vaccination rates. For hyperparameter tuning, I followed Facebook Prophet’s documentation guidelines, creating a grid of recommended parameters. This grid served as a foundation for exploring various hyperparameter combinations.

In the tuning process, I fitted the model to the training data, maintaining the same initial, period, and horizon settings as before to ensure consistent cross-validation and scoring. After each iteration, performance metrics, particularly the RMSE, were calculated. This approach enabled me to identify the best-performing parameters.

For the final model evaluation, I specifically set rolling_window = 1 during cross-validation. This setting was chosen to treat each forecasted point independently, avoiding any smoothing of errors and providing a more detailed view of the model’s accuracy. The result was a clear picture of the model’s performance on the test data, reflected in the test RMSE.

Code

# Set the logistic growth
train['cap'] = 1  
test['cap'] = 1   

# Initialize and fit the Prophet model on the training data with logistic growth
model = Prophet(growth='logistic')
model.add_country_holidays(country_name='US')
model.fit(train)

# Parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.001, 0.01, 0.1, 0.5],
    'seasonality_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'holidays_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'seasonality_mode': ['additive', 'multiplicative']
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each params 

# Cross-validation to evaluate all parameters
for params in all_params:
    m = Prophet(growth='logistic', **params)
    m.add_country_holidays(country_name='US')
    m.fit(train)
    
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")

# Fit the final model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
final_model.fit(train)

# Predict and evaluate on the test set
future_test = final_model.make_future_dataframe(periods=len(test), freq='W', include_history=False)
# Add the cap to the future dataframe
future_test['cap'] = 1
forecast_test = final_model.predict(future_test)
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f"Test RMSE: {test_rmse}")

# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

16:37:20 - cmdstanpy - INFO - Chain [1] start processing
16:37:20 - cmdstanpy - INFO - Chain [1] done processing
16:37:20 - cmdstanpy - INFO - Chain [1] start processing
16:37:21 - cmdstanpy - INFO - Chain [1] done processing
16:37:22 - cmdstanpy - INFO - Chain [1] start processing
16:37:22 - cmdstanpy - INFO - Chain [1] start processing
16:37:22 - cmdstanpy - INFO - Chain [1] done processing
16:37:22 - cmdstanpy - INFO - Chain [1] start processing
16:37:22 - cmdstanpy - INFO - Chain [1] start processing
16:37:22 - cmdstanpy - INFO - Chain [1] done processing
16:37:22 - cmdstanpy - INFO - Chain [1] done processing
16:37:22 - cmdstanpy - INFO - Chain [1] done processing
16:37:22 - cmdstanpy - INFO - Chain [1] start processing
16:37:23 - cmdstanpy - INFO - Chain [1] done processing
16:37:24 - cmdstanpy - INFO - Chain [1] start processing
16:37:24 - cmdstanpy - INFO - Chain [1] start processing
16:37:24 - cmdstanpy - INFO - Chain [1] start processing
16:37:24 - cmdstanpy - INFO - Chain [1] start processing
16:37:24 - cmdstanpy - INFO - Chain [1] done processing
16:37:24 - cmdstanpy - INFO - Chain [1] done processing
16:37:24 - cmdstanpy - INFO - Chain [1] done processing
16:37:24 - cmdstanpy - INFO - Chain [1] done processing
16:37:24 - cmdstanpy - INFO - Chain [1] start processing
16:37:26 - cmdstanpy - INFO - Chain [1] done processing
16:37:26 - cmdstanpy - INFO - Chain [1] start processing
16:37:26 - cmdstanpy - INFO - Chain [1] done processing
16:37:27 - cmdstanpy - INFO - Chain [1] start processing
16:37:27 - cmdstanpy - INFO - Chain [1] start processing
16:37:27 - cmdstanpy - INFO - Chain [1] start processing
16:37:27 - cmdstanpy - INFO - Chain [1] done processing
16:37:27 - cmdstanpy - INFO - Chain [1] done processing
16:37:27 - cmdstanpy - INFO - Chain [1] done processing
16:37:27 - cmdstanpy - INFO - Chain [1] start processing
16:37:28 - cmdstanpy - INFO - Chain [1] done processing
16:37:29 - cmdstanpy - INFO - Chain [1] start processing
16:37:29 - cmdstanpy - INFO - Chain [1] start processing
16:37:29 - cmdstanpy - INFO - Chain [1] done processing
16:37:29 - cmdstanpy - INFO - Chain [1] start processing
16:37:29 - cmdstanpy - INFO - Chain [1] start processing
16:37:29 - cmdstanpy - INFO - Chain [1] done processing
16:37:29 - cmdstanpy - INFO - Chain [1] done processing
16:37:29 - cmdstanpy - INFO - Chain [1] done processing
16:37:29 - cmdstanpy - INFO - Chain [1] start processing
16:37:30 - cmdstanpy - INFO - Chain [1] done processing
16:37:31 - cmdstanpy - INFO - Chain [1] start processing
16:37:31 - cmdstanpy - INFO - Chain [1] start processing
16:37:31 - cmdstanpy - INFO - Chain [1] done processing
16:37:31 - cmdstanpy - INFO - Chain [1] start processing
16:37:31 - cmdstanpy - INFO - Chain [1] start processing
16:37:31 - cmdstanpy - INFO - Chain [1] done processing
16:37:31 - cmdstanpy - INFO - Chain [1] done processing
16:37:31 - cmdstanpy - INFO - Chain [1] done processing
16:37:31 - cmdstanpy - INFO - Chain [1] start processing
16:37:32 - cmdstanpy - INFO - Chain [1] done processing
16:37:33 - cmdstanpy - INFO - Chain [1] start processing
16:37:33 - cmdstanpy - INFO - Chain [1] start processing
16:37:33 - cmdstanpy - INFO - Chain [1] start processing
16:37:33 - cmdstanpy - INFO - Chain [1] done processing
16:37:33 - cmdstanpy - INFO - Chain [1] start processing
16:37:33 - cmdstanpy - INFO - Chain [1] done processing
16:37:33 - cmdstanpy - INFO - Chain [1] done processing
16:37:33 - cmdstanpy - INFO - Chain [1] done processing
16:37:33 - cmdstanpy - INFO - Chain [1] start processing
16:37:35 - cmdstanpy - INFO - Chain [1] done processing
16:37:35 - cmdstanpy - INFO - Chain [1] start processing
16:37:36 - cmdstanpy - INFO - Chain [1] start processing
16:37:36 - cmdstanpy - INFO - Chain [1] start processing
16:37:36 - cmdstanpy - INFO - Chain [1] start processing
16:37:36 - cmdstanpy - INFO - Chain [1] done processing
16:37:36 - cmdstanpy - INFO - Chain [1] done processing
16:37:36 - cmdstanpy - INFO - Chain [1] done processing
16:37:36 - cmdstanpy - INFO - Chain [1] done processing
16:37:36 - cmdstanpy - INFO - Chain [1] start processing
16:37:37 - cmdstanpy - INFO - Chain [1] done processing
16:37:38 - cmdstanpy - INFO - Chain [1] start processing
16:37:38 - cmdstanpy - INFO - Chain [1] start processing
16:37:38 - cmdstanpy - INFO - Chain [1] start processing
16:37:38 - cmdstanpy - INFO - Chain [1] start processing
16:37:38 - cmdstanpy - INFO - Chain [1] done processing
16:37:38 - cmdstanpy - INFO - Chain [1] done processing
16:37:38 - cmdstanpy - INFO - Chain [1] done processing
16:37:38 - cmdstanpy - INFO - Chain [1] done processing
16:37:38 - cmdstanpy - INFO - Chain [1] start processing
16:37:39 - cmdstanpy - INFO - Chain [1] done processing
16:37:40 - cmdstanpy - INFO - Chain [1] start processing
16:37:40 - cmdstanpy - INFO - Chain [1] start processing
16:37:40 - cmdstanpy - INFO - Chain [1] start processing
16:37:40 - cmdstanpy - INFO - Chain [1] start processing
16:37:40 - cmdstanpy - INFO - Chain [1] done processing
16:37:40 - cmdstanpy - INFO - Chain [1] done processing
16:37:40 - cmdstanpy - INFO - Chain [1] done processing
16:37:40 - cmdstanpy - INFO - Chain [1] done processing
16:37:40 - cmdstanpy - INFO - Chain [1] start processing
16:37:41 - cmdstanpy - INFO - Chain [1] done processing
16:37:42 - cmdstanpy - INFO - Chain [1] start processing
16:37:42 - cmdstanpy - INFO - Chain [1] start processing
16:37:42 - cmdstanpy - INFO - Chain [1] done processing
16:37:42 - cmdstanpy - INFO - Chain [1] start processing
16:37:42 - cmdstanpy - INFO - Chain [1] start processing
16:37:42 - cmdstanpy - INFO - Chain [1] done processing
16:37:42 - cmdstanpy - INFO - Chain [1] done processing
16:37:43 - cmdstanpy - INFO - Chain [1] done processing
16:37:43 - cmdstanpy - INFO - Chain [1] start processing
16:37:44 - cmdstanpy - INFO - Chain [1] done processing
16:37:45 - cmdstanpy - INFO - Chain [1] start processing
16:37:45 - cmdstanpy - INFO - Chain [1] done processing
16:37:45 - cmdstanpy - INFO - Chain [1] start processing
16:37:45 - cmdstanpy - INFO - Chain [1] start processing
16:37:45 - cmdstanpy - INFO - Chain [1] start processing
16:37:45 - cmdstanpy - INFO - Chain [1] done processing
16:37:45 - cmdstanpy - INFO - Chain [1] done processing
16:37:45 - cmdstanpy - INFO - Chain [1] done processing
16:37:45 - cmdstanpy - INFO - Chain [1] start processing
16:37:46 - cmdstanpy - INFO - Chain [1] done processing
16:37:47 - cmdstanpy - INFO - Chain [1] start processing
16:37:47 - cmdstanpy - INFO - Chain [1] start processing
16:37:47 - cmdstanpy - INFO - Chain [1] start processing
16:37:47 - cmdstanpy - INFO - Chain [1] start processing
16:37:47 - cmdstanpy - INFO - Chain [1] done processing
16:37:47 - cmdstanpy - INFO - Chain [1] done processing
16:37:47 - cmdstanpy - INFO - Chain [1] done processing
16:37:47 - cmdstanpy - INFO - Chain [1] done processing
16:37:47 - cmdstanpy - INFO - Chain [1] start processing
16:37:48 - cmdstanpy - INFO - Chain [1] done processing
16:37:49 - cmdstanpy - INFO - Chain [1] start processing
16:37:49 - cmdstanpy - INFO - Chain [1] start processing
16:37:49 - cmdstanpy - INFO - Chain [1] start processing
16:37:49 - cmdstanpy - INFO - Chain [1] start processing
16:37:49 - cmdstanpy - INFO - Chain [1] done processing
16:37:49 - cmdstanpy - INFO - Chain [1] done processing
16:37:49 - cmdstanpy - INFO - Chain [1] done processing
16:37:50 - cmdstanpy - INFO - Chain [1] done processing
16:37:50 - cmdstanpy - INFO - Chain [1] start processing
16:37:51 - cmdstanpy - INFO - Chain [1] done processing
16:37:52 - cmdstanpy - INFO - Chain [1] start processing
16:37:52 - cmdstanpy - INFO - Chain [1] start processing
16:37:52 - cmdstanpy - INFO - Chain [1] start processing
16:37:52 - cmdstanpy - INFO - Chain [1] done processing
16:37:52 - cmdstanpy - INFO - Chain [1] start processing
16:37:52 - cmdstanpy - INFO - Chain [1] done processing
16:37:52 - cmdstanpy - INFO - Chain [1] done processing
16:37:52 - cmdstanpy - INFO - Chain [1] done processing
16:37:52 - cmdstanpy - INFO - Chain [1] start processing
16:37:53 - cmdstanpy - INFO - Chain [1] done processing
16:37:54 - cmdstanpy - INFO - Chain [1] start processing
16:37:54 - cmdstanpy - INFO - Chain [1] start processing
16:37:54 - cmdstanpy - INFO - Chain [1] start processing
16:37:54 - cmdstanpy - INFO - Chain [1] start processing
16:37:54 - cmdstanpy - INFO - Chain [1] done processing
16:37:54 - cmdstanpy - INFO - Chain [1] done processing
16:37:54 - cmdstanpy - INFO - Chain [1] done processing
16:37:54 - cmdstanpy - INFO - Chain [1] done processing
16:37:54 - cmdstanpy - INFO - Chain [1] start processing
16:37:55 - cmdstanpy - INFO - Chain [1] done processing
16:37:56 - cmdstanpy - INFO - Chain [1] start processing
16:37:56 - cmdstanpy - INFO - Chain [1] start processing
16:37:56 - cmdstanpy - INFO - Chain [1] start processing
16:37:56 - cmdstanpy - INFO - Chain [1] start processing
16:37:56 - cmdstanpy - INFO - Chain [1] done processing
16:37:56 - cmdstanpy - INFO - Chain [1] done processing
16:37:56 - cmdstanpy - INFO - Chain [1] done processing
16:37:57 - cmdstanpy - INFO - Chain [1] done processing
16:37:57 - cmdstanpy - INFO - Chain [1] start processing
16:37:58 - cmdstanpy - INFO - Chain [1] done processing
16:37:59 - cmdstanpy - INFO - Chain [1] start processing
16:37:59 - cmdstanpy - INFO - Chain [1] start processing
16:37:59 - cmdstanpy - INFO - Chain [1] start processing
16:37:59 - cmdstanpy - INFO - Chain [1] done processing
16:37:59 - cmdstanpy - INFO - Chain [1] start processing
16:37:59 - cmdstanpy - INFO - Chain [1] done processing
16:37:59 - cmdstanpy - INFO - Chain [1] done processing
16:37:59 - cmdstanpy - INFO - Chain [1] done processing
16:37:59 - cmdstanpy - INFO - Chain [1] start processing
16:38:00 - cmdstanpy - INFO - Chain [1] done processing
16:38:01 - cmdstanpy - INFO - Chain [1] start processing
16:38:01 - cmdstanpy - INFO - Chain [1] start processing
16:38:01 - cmdstanpy - INFO - Chain [1] start processing
16:38:01 - cmdstanpy - INFO - Chain [1] start processing
16:38:01 - cmdstanpy - INFO - Chain [1] done processing
16:38:01 - cmdstanpy - INFO - Chain [1] done processing
16:38:01 - cmdstanpy - INFO - Chain [1] done processing
16:38:01 - cmdstanpy - INFO - Chain [1] done processing
16:38:01 - cmdstanpy - INFO - Chain [1] start processing
16:38:02 - cmdstanpy - INFO - Chain [1] done processing
16:38:03 - cmdstanpy - INFO - Chain [1] start processing
16:38:03 - cmdstanpy - INFO - Chain [1] start processing
16:38:03 - cmdstanpy - INFO - Chain [1] start processing
16:38:03 - cmdstanpy - INFO - Chain [1] start processing
16:38:03 - cmdstanpy - INFO - Chain [1] done processing
16:38:03 - cmdstanpy - INFO - Chain [1] done processing
16:38:03 - cmdstanpy - INFO - Chain [1] done processing
16:38:03 - cmdstanpy - INFO - Chain [1] done processing
16:38:03 - cmdstanpy - INFO - Chain [1] start processing
16:38:05 - cmdstanpy - INFO - Chain [1] done processing
16:38:05 - cmdstanpy - INFO - Chain [1] start processing
16:38:05 - cmdstanpy - INFO - Chain [1] start processing
16:38:05 - cmdstanpy - INFO - Chain [1] done processing
16:38:05 - cmdstanpy - INFO - Chain [1] start processing
16:38:05 - cmdstanpy - INFO - Chain [1] start processing
16:38:05 - cmdstanpy - INFO - Chain [1] done processing
16:38:05 - cmdstanpy - INFO - Chain [1] done processing
16:38:06 - cmdstanpy - INFO - Chain [1] done processing
16:38:06 - cmdstanpy - INFO - Chain [1] start processing
16:38:07 - cmdstanpy - INFO - Chain [1] done processing
16:38:08 - cmdstanpy - INFO - Chain [1] start processing
16:38:08 - cmdstanpy - INFO - Chain [1] start processing
16:38:08 - cmdstanpy - INFO - Chain [1] start processing
16:38:08 - cmdstanpy - INFO - Chain [1] start processing
16:38:08 - cmdstanpy - INFO - Chain [1] done processing
16:38:08 - cmdstanpy - INFO - Chain [1] done processing
16:38:08 - cmdstanpy - INFO - Chain [1] done processing
16:38:08 - cmdstanpy - INFO - Chain [1] done processing
16:38:08 - cmdstanpy - INFO - Chain [1] start processing
16:38:09 - cmdstanpy - INFO - Chain [1] done processing
16:38:10 - cmdstanpy - INFO - Chain [1] start processing
16:38:10 - cmdstanpy - INFO - Chain [1] start processing
16:38:10 - cmdstanpy - INFO - Chain [1] start processing
16:38:10 - cmdstanpy - INFO - Chain [1] start processing
16:38:10 - cmdstanpy - INFO - Chain [1] done processing
16:38:10 - cmdstanpy - INFO - Chain [1] done processing
16:38:10 - cmdstanpy - INFO - Chain [1] done processing
16:38:10 - cmdstanpy - INFO - Chain [1] done processing
16:38:10 - cmdstanpy - INFO - Chain [1] start processing
16:38:11 - cmdstanpy - INFO - Chain [1] done processing
16:38:12 - cmdstanpy - INFO - Chain [1] start processing
16:38:12 - cmdstanpy - INFO - Chain [1] start processing
16:38:12 - cmdstanpy - INFO - Chain [1] start processing
16:38:12 - cmdstanpy - INFO - Chain [1] start processing
16:38:12 - cmdstanpy - INFO - Chain [1] done processing
16:38:12 - cmdstanpy - INFO - Chain [1] done processing
16:38:12 - cmdstanpy - INFO - Chain [1] done processing
16:38:12 - cmdstanpy - INFO - Chain [1] done processing
16:38:12 - cmdstanpy - INFO - Chain [1] start processing
16:38:13 - cmdstanpy - INFO - Chain [1] done processing
16:38:14 - cmdstanpy - INFO - Chain [1] start processing
16:38:14 - cmdstanpy - INFO - Chain [1] start processing
16:38:14 - cmdstanpy - INFO - Chain [1] start processing
16:38:14 - cmdstanpy - INFO - Chain [1] start processing
16:38:14 - cmdstanpy - INFO - Chain [1] done processing
16:38:14 - cmdstanpy - INFO - Chain [1] done processing
16:38:14 - cmdstanpy - INFO - Chain [1] done processing
16:38:14 - cmdstanpy - INFO - Chain [1] done processing
16:38:15 - cmdstanpy - INFO - Chain [1] start processing
16:38:16 - cmdstanpy - INFO - Chain [1] done processing
16:38:16 - cmdstanpy - INFO - Chain [1] start processing
16:38:17 - cmdstanpy - INFO - Chain [1] start processing
16:38:17 - cmdstanpy - INFO - Chain [1] start processing
16:38:17 - cmdstanpy - INFO - Chain [1] start processing
16:38:17 - cmdstanpy - INFO - Chain [1] done processing
16:38:17 - cmdstanpy - INFO - Chain [1] done processing
16:38:17 - cmdstanpy - INFO - Chain [1] done processing
16:38:17 - cmdstanpy - INFO - Chain [1] done processing
16:38:17 - cmdstanpy - INFO - Chain [1] start processing
16:38:18 - cmdstanpy - INFO - Chain [1] done processing
16:38:19 - cmdstanpy - INFO - Chain [1] start processing
16:38:19 - cmdstanpy - INFO - Chain [1] start processing
16:38:19 - cmdstanpy - INFO - Chain [1] start processing
16:38:19 - cmdstanpy - INFO - Chain [1] start processing
16:38:19 - cmdstanpy - INFO - Chain [1] done processing
16:38:19 - cmdstanpy - INFO - Chain [1] done processing
16:38:19 - cmdstanpy - INFO - Chain [1] done processing
16:38:19 - cmdstanpy - INFO - Chain [1] done processing
16:38:19 - cmdstanpy - INFO - Chain [1] start processing
16:38:20 - cmdstanpy - INFO - Chain [1] done processing
16:38:21 - cmdstanpy - INFO - Chain [1] start processing
16:38:21 - cmdstanpy - INFO - Chain [1] start processing
16:38:21 - cmdstanpy - INFO - Chain [1] done processing
16:38:21 - cmdstanpy - INFO - Chain [1] start processing
16:38:21 - cmdstanpy - INFO - Chain [1] start processing
16:38:21 - cmdstanpy - INFO - Chain [1] done processing
16:38:21 - cmdstanpy - INFO - Chain [1] done processing
16:38:21 - cmdstanpy - INFO - Chain [1] done processing
16:38:21 - cmdstanpy - INFO - Chain [1] start processing
16:38:22 - cmdstanpy - INFO - Chain [1] done processing
16:38:23 - cmdstanpy - INFO - Chain [1] start processing
16:38:23 - cmdstanpy - INFO - Chain [1] start processing
16:38:23 - cmdstanpy - INFO - Chain [1] start processing
16:38:23 - cmdstanpy - INFO - Chain [1] done processing
16:38:23 - cmdstanpy - INFO - Chain [1] start processing
16:38:23 - cmdstanpy - INFO - Chain [1] done processing
16:38:23 - cmdstanpy - INFO - Chain [1] done processing
16:38:24 - cmdstanpy - INFO - Chain [1] done processing
16:38:24 - cmdstanpy - INFO - Chain [1] start processing
16:38:25 - cmdstanpy - INFO - Chain [1] done processing
16:38:26 - cmdstanpy - INFO - Chain [1] start processing
16:38:26 - cmdstanpy - INFO - Chain [1] start processing
16:38:26 - cmdstanpy - INFO - Chain [1] done processing
16:38:26 - cmdstanpy - INFO - Chain [1] start processing
16:38:26 - cmdstanpy - INFO - Chain [1] start processing
16:38:26 - cmdstanpy - INFO - Chain [1] done processing
16:38:26 - cmdstanpy - INFO - Chain [1] done processing
16:38:26 - cmdstanpy - INFO - Chain [1] done processing
16:38:26 - cmdstanpy - INFO - Chain [1] start processing
16:38:27 - cmdstanpy - INFO - Chain [1] done processing
16:38:28 - cmdstanpy - INFO - Chain [1] start processing
16:38:28 - cmdstanpy - INFO - Chain [1] start processing
16:38:28 - cmdstanpy - INFO - Chain [1] start processing
16:38:28 - cmdstanpy - INFO - Chain [1] done processing
16:38:28 - cmdstanpy - INFO - Chain [1] start processing
16:38:28 - cmdstanpy - INFO - Chain [1] done processing
16:38:28 - cmdstanpy - INFO - Chain [1] done processing
16:38:28 - cmdstanpy - INFO - Chain [1] done processing
16:38:28 - cmdstanpy - INFO - Chain [1] start processing
16:38:29 - cmdstanpy - INFO - Chain [1] done processing
16:38:30 - cmdstanpy - INFO - Chain [1] start processing
16:38:30 - cmdstanpy - INFO - Chain [1] start processing
16:38:30 - cmdstanpy - INFO - Chain [1] start processing
16:38:30 - cmdstanpy - INFO - Chain [1] start processing
16:38:30 - cmdstanpy - INFO - Chain [1] done processing
16:38:30 - cmdstanpy - INFO - Chain [1] done processing
16:38:30 - cmdstanpy - INFO - Chain [1] done processing
16:38:30 - cmdstanpy - INFO - Chain [1] done processing
16:38:30 - cmdstanpy - INFO - Chain [1] start processing
16:38:32 - cmdstanpy - INFO - Chain [1] done processing
16:38:32 - cmdstanpy - INFO - Chain [1] start processing
16:38:32 - cmdstanpy - INFO - Chain [1] start processing
16:38:32 - cmdstanpy - INFO - Chain [1] start processing
16:38:32 - cmdstanpy - INFO - Chain [1] start processing
16:38:32 - cmdstanpy - INFO - Chain [1] done processing
16:38:32 - cmdstanpy - INFO - Chain [1] done processing
16:38:33 - cmdstanpy - INFO - Chain [1] done processing
16:38:33 - cmdstanpy - INFO - Chain [1] done processing
16:38:33 - cmdstanpy - INFO - Chain [1] start processing
16:38:33 - cmdstanpy - INFO - Chain [1] done processing
16:38:34 - cmdstanpy - INFO - Chain [1] start processing
16:38:34 - cmdstanpy - INFO - Chain [1] done processing
16:38:34 - cmdstanpy - INFO - Chain [1] start processing
16:38:34 - cmdstanpy - INFO - Chain [1] start processing
16:38:34 - cmdstanpy - INFO - Chain [1] start processing
16:38:34 - cmdstanpy - INFO - Chain [1] done processing
16:38:34 - cmdstanpy - INFO - Chain [1] done processing
16:38:34 - cmdstanpy - INFO - Chain [1] done processing
16:38:34 - cmdstanpy - INFO - Chain [1] start processing
16:38:34 - cmdstanpy - INFO - Chain [1] done processing
16:38:35 - cmdstanpy - INFO - Chain [1] start processing
16:38:35 - cmdstanpy - INFO - Chain [1] start processing
16:38:35 - cmdstanpy - INFO - Chain [1] start processing
16:38:35 - cmdstanpy - INFO - Chain [1] done processing
16:38:35 - cmdstanpy - INFO - Chain [1] start processing
16:38:35 - cmdstanpy - INFO - Chain [1] done processing
16:38:35 - cmdstanpy - INFO - Chain [1] done processing
16:38:35 - cmdstanpy - INFO - Chain [1] done processing
16:38:35 - cmdstanpy - INFO - Chain [1] start processing
16:38:35 - cmdstanpy - INFO - Chain [1] done processing
16:38:36 - cmdstanpy - INFO - Chain [1] start processing
16:38:36 - cmdstanpy - INFO - Chain [1] start processing
16:38:36 - cmdstanpy - INFO - Chain [1] done processing
16:38:36 - cmdstanpy - INFO - Chain [1] start processing
16:38:36 - cmdstanpy - INFO - Chain [1] start processing
16:38:36 - cmdstanpy - INFO - Chain [1] done processing
16:38:36 - cmdstanpy - INFO - Chain [1] done processing
16:38:36 - cmdstanpy - INFO - Chain [1] done processing
16:38:36 - cmdstanpy - INFO - Chain [1] start processing
16:38:37 - cmdstanpy - INFO - Chain [1] done processing
16:38:37 - cmdstanpy - INFO - Chain [1] start processing
16:38:37 - cmdstanpy - INFO - Chain [1] start processing
16:38:37 - cmdstanpy - INFO - Chain [1] start processing
16:38:37 - cmdstanpy - INFO - Chain [1] start processing
16:38:37 - cmdstanpy - INFO - Chain [1] done processing
16:38:38 - cmdstanpy - INFO - Chain [1] done processing
16:38:38 - cmdstanpy - INFO - Chain [1] done processing
16:38:38 - cmdstanpy - INFO - Chain [1] done processing
16:38:38 - cmdstanpy - INFO - Chain [1] start processing
16:38:38 - cmdstanpy - INFO - Chain [1] done processing
16:38:39 - cmdstanpy - INFO - Chain [1] start processing
16:38:39 - cmdstanpy - INFO - Chain [1] start processing
16:38:39 - cmdstanpy - INFO - Chain [1] done processing
16:38:39 - cmdstanpy - INFO - Chain [1] start processing
16:38:39 - cmdstanpy - INFO - Chain [1] start processing
16:38:39 - cmdstanpy - INFO - Chain [1] done processing
16:38:39 - cmdstanpy - INFO - Chain [1] done processing
16:38:39 - cmdstanpy - INFO - Chain [1] done processing
16:38:39 - cmdstanpy - INFO - Chain [1] start processing
16:38:39 - cmdstanpy - INFO - Chain [1] done processing
16:38:40 - cmdstanpy - INFO - Chain [1] start processing
16:38:40 - cmdstanpy - INFO - Chain [1] start processing
16:38:40 - cmdstanpy - INFO - Chain [1] done processing
16:38:40 - cmdstanpy - INFO - Chain [1] start processing
16:38:40 - cmdstanpy - INFO - Chain [1] start processing
16:38:40 - cmdstanpy - INFO - Chain [1] done processing
16:38:40 - cmdstanpy - INFO - Chain [1] done processing
16:38:40 - cmdstanpy - INFO - Chain [1] done processing
16:38:40 - cmdstanpy - INFO - Chain [1] start processing
16:38:40 - cmdstanpy - INFO - Chain [1] done processing
16:38:41 - cmdstanpy - INFO - Chain [1] start processing
16:38:41 - cmdstanpy - INFO - Chain [1] start processing
16:38:41 - cmdstanpy - INFO - Chain [1] done processing
16:38:41 - cmdstanpy - INFO - Chain [1] start processing
16:38:41 - cmdstanpy - INFO - Chain [1] start processing
16:38:41 - cmdstanpy - INFO - Chain [1] done processing
16:38:41 - cmdstanpy - INFO - Chain [1] done processing
16:38:42 - cmdstanpy - INFO - Chain [1] done processing
16:38:42 - cmdstanpy - INFO - Chain [1] start processing
16:38:42 - cmdstanpy - INFO - Chain [1] done processing
16:38:43 - cmdstanpy - INFO - Chain [1] start processing
16:38:43 - cmdstanpy - INFO - Chain [1] start processing
16:38:43 - cmdstanpy - INFO - Chain [1] done processing
16:38:43 - cmdstanpy - INFO - Chain [1] start processing
16:38:43 - cmdstanpy - INFO - Chain [1] start processing
16:38:43 - cmdstanpy - INFO - Chain [1] done processing
16:38:43 - cmdstanpy - INFO - Chain [1] done processing
16:38:43 - cmdstanpy - INFO - Chain [1] done processing
16:38:43 - cmdstanpy - INFO - Chain [1] start processing
16:38:43 - cmdstanpy - INFO - Chain [1] done processing
16:38:44 - cmdstanpy - INFO - Chain [1] start processing
16:38:44 - cmdstanpy - INFO - Chain [1] start processing
16:38:44 - cmdstanpy - INFO - Chain [1] done processing
16:38:44 - cmdstanpy - INFO - Chain [1] start processing
16:38:44 - cmdstanpy - INFO - Chain [1] start processing
16:38:44 - cmdstanpy - INFO - Chain [1] done processing
16:38:44 - cmdstanpy - INFO - Chain [1] done processing
16:38:44 - cmdstanpy - INFO - Chain [1] done processing
16:38:44 - cmdstanpy - INFO - Chain [1] start processing
16:38:44 - cmdstanpy - INFO - Chain [1] done processing
16:38:45 - cmdstanpy - INFO - Chain [1] start processing
16:38:45 - cmdstanpy - INFO - Chain [1] start processing
16:38:45 - cmdstanpy - INFO - Chain [1] done processing
16:38:45 - cmdstanpy - INFO - Chain [1] start processing
16:38:45 - cmdstanpy - INFO - Chain [1] done processing
16:38:45 - cmdstanpy - INFO - Chain [1] start processing
16:38:45 - cmdstanpy - INFO - Chain [1] done processing
16:38:45 - cmdstanpy - INFO - Chain [1] done processing
16:38:45 - cmdstanpy - INFO - Chain [1] start processing
16:38:46 - cmdstanpy - INFO - Chain [1] done processing
16:38:46 - cmdstanpy - INFO - Chain [1] start processing
16:38:47 - cmdstanpy - INFO - Chain [1] done processing
16:38:47 - cmdstanpy - INFO - Chain [1] start processing
16:38:47 - cmdstanpy - INFO - Chain [1] start processing
16:38:47 - cmdstanpy - INFO - Chain [1] start processing
16:38:47 - cmdstanpy - INFO - Chain [1] done processing
16:38:47 - cmdstanpy - INFO - Chain [1] done processing
16:38:47 - cmdstanpy - INFO - Chain [1] done processing
16:38:47 - cmdstanpy - INFO - Chain [1] start processing
16:38:47 - cmdstanpy - INFO - Chain [1] done processing
16:38:48 - cmdstanpy - INFO - Chain [1] start processing
16:38:48 - cmdstanpy - INFO - Chain [1] done processing
16:38:48 - cmdstanpy - INFO - Chain [1] start processing
16:38:48 - cmdstanpy - INFO - Chain [1] start processing
16:38:48 - cmdstanpy - INFO - Chain [1] start processing
16:38:48 - cmdstanpy - INFO - Chain [1] done processing
16:38:48 - cmdstanpy - INFO - Chain [1] done processing
16:38:48 - cmdstanpy - INFO - Chain [1] done processing
16:38:48 - cmdstanpy - INFO - Chain [1] start processing
16:38:48 - cmdstanpy - INFO - Chain [1] done processing
16:38:49 - cmdstanpy - INFO - Chain [1] start processing
16:38:49 - cmdstanpy - INFO - Chain [1] start processing
16:38:49 - cmdstanpy - INFO - Chain [1] done processing
16:38:49 - cmdstanpy - INFO - Chain [1] start processing
16:38:49 - cmdstanpy - INFO - Chain [1] start processing
16:38:49 - cmdstanpy - INFO - Chain [1] done processing
16:38:49 - cmdstanpy - INFO - Chain [1] done processing
16:38:49 - cmdstanpy - INFO - Chain [1] done processing
16:38:49 - cmdstanpy - INFO - Chain [1] start processing
16:38:50 - cmdstanpy - INFO - Chain [1] done processing
16:38:50 - cmdstanpy - INFO - Chain [1] start processing
16:38:50 - cmdstanpy - INFO - Chain [1] start processing
16:38:50 - cmdstanpy - INFO - Chain [1] done processing
16:38:50 - cmdstanpy - INFO - Chain [1] start processing
16:38:51 - cmdstanpy - INFO - Chain [1] start processing
16:38:51 - cmdstanpy - INFO - Chain [1] done processing
16:38:51 - cmdstanpy - INFO - Chain [1] done processing
16:38:51 - cmdstanpy - INFO - Chain [1] done processing
16:38:51 - cmdstanpy - INFO - Chain [1] start processing
16:38:51 - cmdstanpy - INFO - Chain [1] done processing
16:38:52 - cmdstanpy - INFO - Chain [1] start processing
16:38:52 - cmdstanpy - INFO - Chain [1] start processing
16:38:52 - cmdstanpy - INFO - Chain [1] start processing
16:38:52 - cmdstanpy - INFO - Chain [1] done processing
16:38:52 - cmdstanpy - INFO - Chain [1] start processing
16:38:52 - cmdstanpy - INFO - Chain [1] done processing
16:38:52 - cmdstanpy - INFO - Chain [1] done processing
16:38:52 - cmdstanpy - INFO - Chain [1] done processing
16:38:52 - cmdstanpy - INFO - Chain [1] start processing
16:38:52 - cmdstanpy - INFO - Chain [1] done processing
16:38:53 - cmdstanpy - INFO - Chain [1] start processing
16:38:53 - cmdstanpy - INFO - Chain [1] start processing
16:38:53 - cmdstanpy - INFO - Chain [1] done processing
16:38:53 - cmdstanpy - INFO - Chain [1] start processing
16:38:53 - cmdstanpy - INFO - Chain [1] start processing
16:38:53 - cmdstanpy - INFO - Chain [1] done processing
16:38:53 - cmdstanpy - INFO - Chain [1] done processing
16:38:53 - cmdstanpy - INFO - Chain [1] done processing
16:38:53 - cmdstanpy - INFO - Chain [1] start processing
16:38:54 - cmdstanpy - INFO - Chain [1] done processing
16:38:54 - cmdstanpy - INFO - Chain [1] start processing
16:38:54 - cmdstanpy - INFO - Chain [1] start processing
16:38:54 - cmdstanpy - INFO - Chain [1] done processing
16:38:54 - cmdstanpy - INFO - Chain [1] start processing
16:38:54 - cmdstanpy - INFO - Chain [1] start processing
16:38:55 - cmdstanpy - INFO - Chain [1] done processing
16:38:55 - cmdstanpy - INFO - Chain [1] done processing
16:38:55 - cmdstanpy - INFO - Chain [1] done processing
16:38:55 - cmdstanpy - INFO - Chain [1] start processing
16:38:55 - cmdstanpy - INFO - Chain [1] done processing
16:38:56 - cmdstanpy - INFO - Chain [1] start processing
16:38:56 - cmdstanpy - INFO - Chain [1] start processing
16:38:56 - cmdstanpy - INFO - Chain [1] done processing
16:38:56 - cmdstanpy - INFO - Chain [1] start processing
16:38:56 - cmdstanpy - INFO - Chain [1] start processing
16:38:56 - cmdstanpy - INFO - Chain [1] done processing
16:38:56 - cmdstanpy - INFO - Chain [1] done processing
16:38:56 - cmdstanpy - INFO - Chain [1] done processing
16:38:56 - cmdstanpy - INFO - Chain [1] start processing
16:38:56 - cmdstanpy - INFO - Chain [1] done processing
16:38:57 - cmdstanpy - INFO - Chain [1] start processing
16:38:57 - cmdstanpy - INFO - Chain [1] start processing
16:38:57 - cmdstanpy - INFO - Chain [1] done processing
16:38:57 - cmdstanpy - INFO - Chain [1] start processing
16:38:57 - cmdstanpy - INFO - Chain [1] start processing
16:38:57 - cmdstanpy - INFO - Chain [1] done processing
16:38:57 - cmdstanpy - INFO - Chain [1] done processing
16:38:57 - cmdstanpy - INFO - Chain [1] done processing
16:38:57 - cmdstanpy - INFO - Chain [1] start processing
16:38:58 - cmdstanpy - INFO - Chain [1] done processing
16:38:58 - cmdstanpy - INFO - Chain [1] start processing
16:38:58 - cmdstanpy - INFO - Chain [1] start processing
16:38:58 - cmdstanpy - INFO - Chain [1] done processing
16:38:58 - cmdstanpy - INFO - Chain [1] start processing
16:38:59 - cmdstanpy - INFO - Chain [1] start processing
16:38:59 - cmdstanpy - INFO - Chain [1] done processing
16:38:59 - cmdstanpy - INFO - Chain [1] done processing
16:38:59 - cmdstanpy - INFO - Chain [1] done processing
16:38:59 - cmdstanpy - INFO - Chain [1] start processing
16:38:59 - cmdstanpy - INFO - Chain [1] done processing
16:39:00 - cmdstanpy - INFO - Chain [1] start processing
16:39:00 - cmdstanpy - INFO - Chain [1] start processing
16:39:00 - cmdstanpy - INFO - Chain [1] start processing
16:39:00 - cmdstanpy - INFO - Chain [1] start processing
16:39:00 - cmdstanpy - INFO - Chain [1] done processing
16:39:00 - cmdstanpy - INFO - Chain [1] done processing
16:39:00 - cmdstanpy - INFO - Chain [1] done processing
16:39:00 - cmdstanpy - INFO - Chain [1] done processing
16:39:00 - cmdstanpy - INFO - Chain [1] start processing
16:39:00 - cmdstanpy - INFO - Chain [1] done processing
16:39:01 - cmdstanpy - INFO - Chain [1] start processing
16:39:01 - cmdstanpy - INFO - Chain [1] start processing
16:39:01 - cmdstanpy - INFO - Chain [1] done processing
16:39:01 - cmdstanpy - INFO - Chain [1] start processing
16:39:01 - cmdstanpy - INFO - Chain [1] start processing
16:39:01 - cmdstanpy - INFO - Chain [1] done processing
16:39:01 - cmdstanpy - INFO - Chain [1] done processing
16:39:01 - cmdstanpy - INFO - Chain [1] done processing
16:39:01 - cmdstanpy - INFO - Chain [1] start processing
16:39:01 - cmdstanpy - INFO - Chain [1] done processing
16:39:02 - cmdstanpy - INFO - Chain [1] start processing
16:39:02 - cmdstanpy - INFO - Chain [1] start processing
16:39:02 - cmdstanpy - INFO - Chain [1] done processing
16:39:02 - cmdstanpy - INFO - Chain [1] start processing
16:39:02 - cmdstanpy - INFO - Chain [1] start processing
16:39:02 - cmdstanpy - INFO - Chain [1] done processing
16:39:02 - cmdstanpy - INFO - Chain [1] done processing
16:39:03 - cmdstanpy - INFO - Chain [1] done processing
16:39:03 - cmdstanpy - INFO - Chain [1] start processing
16:39:03 - cmdstanpy - INFO - Chain [1] done processing
16:39:04 - cmdstanpy - INFO - Chain [1] start processing
16:39:04 - cmdstanpy - INFO - Chain [1] start processing
16:39:04 - cmdstanpy - INFO - Chain [1] start processing
16:39:04 - cmdstanpy - INFO - Chain [1] start processing
16:39:04 - cmdstanpy - INFO - Chain [1] done processing
16:39:04 - cmdstanpy - INFO - Chain [1] done processing
16:39:04 - cmdstanpy - INFO - Chain [1] done processing
16:39:04 - cmdstanpy - INFO - Chain [1] done processing
16:39:04 - cmdstanpy - INFO - Chain [1] start processing
16:39:04 - cmdstanpy - INFO - Chain [1] done processing
16:39:05 - cmdstanpy - INFO - Chain [1] start processing
16:39:05 - cmdstanpy - INFO - Chain [1] done processing
16:39:05 - cmdstanpy - INFO - Chain [1] start processing
16:39:05 - cmdstanpy - INFO - Chain [1] start processing
16:39:05 - cmdstanpy - INFO - Chain [1] start processing
16:39:05 - cmdstanpy - INFO - Chain [1] done processing
16:39:05 - cmdstanpy - INFO - Chain [1] done processing
16:39:05 - cmdstanpy - INFO - Chain [1] done processing
16:39:05 - cmdstanpy - INFO - Chain [1] start processing
16:39:05 - cmdstanpy - INFO - Chain [1] done processing
16:39:06 - cmdstanpy - INFO - Chain [1] start processing
16:39:06 - cmdstanpy - INFO - Chain [1] start processing
16:39:06 - cmdstanpy - INFO - Chain [1] done processing
16:39:06 - cmdstanpy - INFO - Chain [1] start processing
16:39:06 - cmdstanpy - INFO - Chain [1] start processing
16:39:06 - cmdstanpy - INFO - Chain [1] done processing
16:39:06 - cmdstanpy - INFO - Chain [1] done processing
16:39:06 - cmdstanpy - INFO - Chain [1] done processing
16:39:06 - cmdstanpy - INFO - Chain [1] start processing
16:39:07 - cmdstanpy - INFO - Chain [1] done processing
16:39:07 - cmdstanpy - INFO - Chain [1] start processing
16:39:08 - cmdstanpy - INFO - Chain [1] start processing
16:39:08 - cmdstanpy - INFO - Chain [1] start processing
16:39:08 - cmdstanpy - INFO - Chain [1] start processing
16:39:08 - cmdstanpy - INFO - Chain [1] done processing
16:39:08 - cmdstanpy - INFO - Chain [1] done processing
16:39:08 - cmdstanpy - INFO - Chain [1] done processing
16:39:08 - cmdstanpy - INFO - Chain [1] done processing
16:39:08 - cmdstanpy - INFO - Chain [1] start processing
16:39:08 - cmdstanpy - INFO - Chain [1] done processing
16:39:09 - cmdstanpy - INFO - Chain [1] start processing
16:39:09 - cmdstanpy - INFO - Chain [1] start processing
16:39:09 - cmdstanpy - INFO - Chain [1] done processing
16:39:09 - cmdstanpy - INFO - Chain [1] start processing
16:39:09 - cmdstanpy - INFO - Chain [1] start processing
16:39:09 - cmdstanpy - INFO - Chain [1] done processing
16:39:09 - cmdstanpy - INFO - Chain [1] done processing
16:39:09 - cmdstanpy - INFO - Chain [1] done processing
16:39:09 - cmdstanpy - INFO - Chain [1] start processing
16:39:09 - cmdstanpy - INFO - Chain [1] done processing
16:39:10 - cmdstanpy - INFO - Chain [1] start processing
16:39:10 - cmdstanpy - INFO - Chain [1] done processing
16:39:10 - cmdstanpy - INFO - Chain [1] start processing
16:39:10 - cmdstanpy - INFO - Chain [1] start processing
16:39:10 - cmdstanpy - INFO - Chain [1] start processing
16:39:10 - cmdstanpy - INFO - Chain [1] done processing
16:39:10 - cmdstanpy - INFO - Chain [1] done processing
16:39:10 - cmdstanpy - INFO - Chain [1] done processing
16:39:10 - cmdstanpy - INFO - Chain [1] start processing
16:39:10 - cmdstanpy - INFO - Chain [1] done processing
16:39:11 - cmdstanpy - INFO - Chain [1] start processing
16:39:11 - cmdstanpy - INFO - Chain [1] done processing
16:39:11 - cmdstanpy - INFO - Chain [1] start processing
16:39:11 - cmdstanpy - INFO - Chain [1] start processing
16:39:11 - cmdstanpy - INFO - Chain [1] start processing
16:39:11 - cmdstanpy - INFO - Chain [1] done processing
16:39:11 - cmdstanpy - INFO - Chain [1] done processing
16:39:12 - cmdstanpy - INFO - Chain [1] done processing
16:39:12 - cmdstanpy - INFO - Chain [1] start processing
16:39:12 - cmdstanpy - INFO - Chain [1] done processing
16:39:13 - cmdstanpy - INFO - Chain [1] start processing
16:39:13 - cmdstanpy - INFO - Chain [1] done processing
16:39:13 - cmdstanpy - INFO - Chain [1] start processing
16:39:13 - cmdstanpy - INFO - Chain [1] start processing
16:39:13 - cmdstanpy - INFO - Chain [1] start processing
16:39:13 - cmdstanpy - INFO - Chain [1] done processing
16:39:13 - cmdstanpy - INFO - Chain [1] done processing
16:39:13 - cmdstanpy - INFO - Chain [1] done processing
16:39:13 - cmdstanpy - INFO - Chain [1] start processing
16:39:13 - cmdstanpy - INFO - Chain [1] done processing
16:39:14 - cmdstanpy - INFO - Chain [1] start processing
16:39:14 - cmdstanpy - INFO - Chain [1] done processing
16:39:14 - cmdstanpy - INFO - Chain [1] start processing
16:39:14 - cmdstanpy - INFO - Chain [1] start processing
16:39:14 - cmdstanpy - INFO - Chain [1] start processing
16:39:14 - cmdstanpy - INFO - Chain [1] done processing
16:39:14 - cmdstanpy - INFO - Chain [1] done processing
16:39:14 - cmdstanpy - INFO - Chain [1] done processing
16:39:14 - cmdstanpy - INFO - Chain [1] start processing
16:39:14 - cmdstanpy - INFO - Chain [1] done processing
16:39:15 - cmdstanpy - INFO - Chain [1] start processing
16:39:15 - cmdstanpy - INFO - Chain [1] start processing
16:39:15 - cmdstanpy - INFO - Chain [1] start processing
16:39:15 - cmdstanpy - INFO - Chain [1] start processing
16:39:15 - cmdstanpy - INFO - Chain [1] done processing
16:39:15 - cmdstanpy - INFO - Chain [1] done processing
16:39:15 - cmdstanpy - INFO - Chain [1] done processing
16:39:16 - cmdstanpy - INFO - Chain [1] done processing
16:39:16 - cmdstanpy - INFO - Chain [1] start processing
16:39:16 - cmdstanpy - INFO - Chain [1] done processing
16:39:17 - cmdstanpy - INFO - Chain [1] start processing
16:39:17 - cmdstanpy - INFO - Chain [1] start processing
16:39:17 - cmdstanpy - INFO - Chain [1] start processing
16:39:17 - cmdstanpy - INFO - Chain [1] start processing
16:39:17 - cmdstanpy - INFO - Chain [1] done processing
16:39:17 - cmdstanpy - INFO - Chain [1] done processing
16:39:17 - cmdstanpy - INFO - Chain [1] done processing
16:39:17 - cmdstanpy - INFO - Chain [1] done processing
16:39:17 - cmdstanpy - INFO - Chain [1] start processing
16:39:17 - cmdstanpy - INFO - Chain [1] done processing
16:39:18 - cmdstanpy - INFO - Chain [1] start processing
16:39:18 - cmdstanpy - INFO - Chain [1] start processing
16:39:18 - cmdstanpy - INFO - Chain [1] start processing
16:39:18 - cmdstanpy - INFO - Chain [1] done processing
16:39:18 - cmdstanpy - INFO - Chain [1] start processing
16:39:18 - cmdstanpy - INFO - Chain [1] done processing
16:39:18 - cmdstanpy - INFO - Chain [1] done processing
16:39:18 - cmdstanpy - INFO - Chain [1] done processing
16:39:19 - cmdstanpy - INFO - Chain [1] start processing
16:39:19 - cmdstanpy - INFO - Chain [1] done processing
16:39:20 - cmdstanpy - INFO - Chain [1] start processing
16:39:20 - cmdstanpy - INFO - Chain [1] start processing
16:39:20 - cmdstanpy - INFO - Chain [1] done processing
16:39:20 - cmdstanpy - INFO - Chain [1] start processing
16:39:20 - cmdstanpy - INFO - Chain [1] start processing
16:39:20 - cmdstanpy - INFO - Chain [1] done processing
16:39:20 - cmdstanpy - INFO - Chain [1] done processing
16:39:20 - cmdstanpy - INFO - Chain [1] done processing
16:39:20 - cmdstanpy - INFO - Chain [1] start processing
16:39:20 - cmdstanpy - INFO - Chain [1] done processing
16:39:21 - cmdstanpy - INFO - Chain [1] start processing
16:39:21 - cmdstanpy - INFO - Chain [1] start processing
16:39:21 - cmdstanpy - INFO - Chain [1] start processing
16:39:21 - cmdstanpy - INFO - Chain [1] done processing
16:39:21 - cmdstanpy - INFO - Chain [1] start processing
16:39:21 - cmdstanpy - INFO - Chain [1] done processing
16:39:21 - cmdstanpy - INFO - Chain [1] done processing
16:39:21 - cmdstanpy - INFO - Chain [1] done processing
16:39:22 - cmdstanpy - INFO - Chain [1] start processing
16:39:22 - cmdstanpy - INFO - Chain [1] done processing
16:39:23 - cmdstanpy - INFO - Chain [1] start processing
16:39:23 - cmdstanpy - INFO - Chain [1] start processing
16:39:23 - cmdstanpy - INFO - Chain [1] start processing
16:39:23 - cmdstanpy - INFO - Chain [1] start processing
16:39:23 - cmdstanpy - INFO - Chain [1] done processing
16:39:23 - cmdstanpy - INFO - Chain [1] done processing
16:39:23 - cmdstanpy - INFO - Chain [1] done processing
16:39:23 - cmdstanpy - INFO - Chain [1] done processing
16:39:23 - cmdstanpy - INFO - Chain [1] start processing
16:39:23 - cmdstanpy - INFO - Chain [1] done processing
16:39:24 - cmdstanpy - INFO - Chain [1] start processing
16:39:24 - cmdstanpy - INFO - Chain [1] start processing
16:39:24 - cmdstanpy - INFO - Chain [1] done processing
16:39:24 - cmdstanpy - INFO - Chain [1] start processing
16:39:24 - cmdstanpy - INFO - Chain [1] start processing
16:39:24 - cmdstanpy - INFO - Chain [1] done processing
16:39:24 - cmdstanpy - INFO - Chain [1] done processing
16:39:24 - cmdstanpy - INFO - Chain [1] done processing
16:39:24 - cmdstanpy - INFO - Chain [1] start processing
16:39:25 - cmdstanpy - INFO - Chain [1] done processing
16:39:25 - cmdstanpy - INFO - Chain [1] start processing
16:39:25 - cmdstanpy - INFO - Chain [1] start processing
16:39:25 - cmdstanpy - INFO - Chain [1] start processing
16:39:25 - cmdstanpy - INFO - Chain [1] start processing
16:39:26 - cmdstanpy - INFO - Chain [1] done processing
16:39:26 - cmdstanpy - INFO - Chain [1] done processing
16:39:26 - cmdstanpy - INFO - Chain [1] done processing
16:39:26 - cmdstanpy - INFO - Chain [1] done processing
16:39:26 - cmdstanpy - INFO - Chain [1] start processing
16:39:26 - cmdstanpy - INFO - Chain [1] done processing
16:39:27 - cmdstanpy - INFO - Chain [1] start processing
16:39:27 - cmdstanpy - INFO - Chain [1] start processing
16:39:27 - cmdstanpy - INFO - Chain [1] done processing
16:39:27 - cmdstanpy - INFO - Chain [1] start processing
16:39:27 - cmdstanpy - INFO - Chain [1] start processing
16:39:27 - cmdstanpy - INFO - Chain [1] done processing
16:39:27 - cmdstanpy - INFO - Chain [1] done processing
16:39:27 - cmdstanpy - INFO - Chain [1] done processing
16:39:27 - cmdstanpy - INFO - Chain [1] start processing
16:39:27 - cmdstanpy - INFO - Chain [1] done processing
16:39:28 - cmdstanpy - INFO - Chain [1] start processing
16:39:28 - cmdstanpy - INFO - Chain [1] start processing
16:39:28 - cmdstanpy - INFO - Chain [1] start processing
16:39:28 - cmdstanpy - INFO - Chain [1] start processing
16:39:28 - cmdstanpy - INFO - Chain [1] done processing
16:39:28 - cmdstanpy - INFO - Chain [1] done processing
16:39:28 - cmdstanpy - INFO - Chain [1] done processing
16:39:29 - cmdstanpy - INFO - Chain [1] done processing
16:39:29 - cmdstanpy - INFO - Chain [1] start processing
16:39:29 - cmdstanpy - INFO - Chain [1] done processing
16:39:30 - cmdstanpy - INFO - Chain [1] start processing
16:39:30 - cmdstanpy - INFO - Chain [1] start processing
16:39:30 - cmdstanpy - INFO - Chain [1] done processing
16:39:30 - cmdstanpy - INFO - Chain [1] start processing
16:39:30 - cmdstanpy - INFO - Chain [1] start processing
16:39:30 - cmdstanpy - INFO - Chain [1] done processing
16:39:30 - cmdstanpy - INFO - Chain [1] done processing
16:39:30 - cmdstanpy - INFO - Chain [1] done processing
16:39:30 - cmdstanpy - INFO - Chain [1] start processing
16:39:30 - cmdstanpy - INFO - Chain [1] done processing
16:39:31 - cmdstanpy - INFO - Chain [1] start processing
16:39:31 - cmdstanpy - INFO - Chain [1] start processing
16:39:31 - cmdstanpy - INFO - Chain [1] start processing
16:39:31 - cmdstanpy - INFO - Chain [1] start processing
16:39:31 - cmdstanpy - INFO - Chain [1] done processing
16:39:31 - cmdstanpy - INFO - Chain [1] done processing
16:39:31 - cmdstanpy - INFO - Chain [1] done processing
16:39:32 - cmdstanpy - INFO - Chain [1] done processing
16:39:32 - cmdstanpy - INFO - Chain [1] start processing
16:39:32 - cmdstanpy - INFO - Chain [1] done processing
16:39:33 - cmdstanpy - INFO - Chain [1] start processing
16:39:33 - cmdstanpy - INFO - Chain [1] start processing
16:39:33 - cmdstanpy - INFO - Chain [1] start processing
16:39:33 - cmdstanpy - INFO - Chain [1] done processing
16:39:33 - cmdstanpy - INFO - Chain [1] start processing
16:39:33 - cmdstanpy - INFO - Chain [1] done processing
16:39:33 - cmdstanpy - INFO - Chain [1] done processing
16:39:33 - cmdstanpy - INFO - Chain [1] done processing
16:39:33 - cmdstanpy - INFO - Chain [1] start processing
16:39:33 - cmdstanpy - INFO - Chain [1] done processing
16:39:34 - cmdstanpy - INFO - Chain [1] start processing
16:39:34 - cmdstanpy - INFO - Chain [1] start processing
16:39:34 - cmdstanpy - INFO - Chain [1] start processing
16:39:34 - cmdstanpy - INFO - Chain [1] done processing
16:39:34 - cmdstanpy - INFO - Chain [1] start processing
16:39:34 - cmdstanpy - INFO - Chain [1] done processing
16:39:34 - cmdstanpy - INFO - Chain [1] done processing
16:39:35 - cmdstanpy - INFO - Chain [1] done processing
16:39:35 - cmdstanpy - INFO - Chain [1] start processing
16:39:35 - cmdstanpy - INFO - Chain [1] done processing
16:39:36 - cmdstanpy - INFO - Chain [1] start processing
16:39:36 - cmdstanpy - INFO - Chain [1] start processing
16:39:36 - cmdstanpy - INFO - Chain [1] done processing
16:39:36 - cmdstanpy - INFO - Chain [1] start processing
16:39:36 - cmdstanpy - INFO - Chain [1] start processing
16:39:36 - cmdstanpy - INFO - Chain [1] done processing
16:39:36 - cmdstanpy - INFO - Chain [1] done processing
16:39:36 - cmdstanpy - INFO - Chain [1] done processing
16:39:36 - cmdstanpy - INFO - Chain [1] start processing
16:39:36 - cmdstanpy - INFO - Chain [1] done processing
16:39:37 - cmdstanpy - INFO - Chain [1] start processing
16:39:37 - cmdstanpy - INFO - Chain [1] start processing
16:39:37 - cmdstanpy - INFO - Chain [1] start processing
16:39:37 - cmdstanpy - INFO - Chain [1] start processing
16:39:37 - cmdstanpy - INFO - Chain [1] done processing
16:39:37 - cmdstanpy - INFO - Chain [1] done processing
16:39:37 - cmdstanpy - INFO - Chain [1] done processing
16:39:37 - cmdstanpy - INFO - Chain [1] done processing
16:39:37 - cmdstanpy - INFO - Chain [1] start processing
16:39:38 - cmdstanpy - INFO - Chain [1] done processing
16:39:39 - cmdstanpy - INFO - Chain [1] start processing
16:39:39 - cmdstanpy - INFO - Chain [1] start processing
16:39:39 - cmdstanpy - INFO - Chain [1] start processing
16:39:39 - cmdstanpy - INFO - Chain [1] done processing
16:39:39 - cmdstanpy - INFO - Chain [1] start processing
16:39:39 - cmdstanpy - INFO - Chain [1] done processing
16:39:39 - cmdstanpy - INFO - Chain [1] done processing
16:39:39 - cmdstanpy - INFO - Chain [1] done processing
16:39:39 - cmdstanpy - INFO - Chain [1] start processing
16:39:39 - cmdstanpy - INFO - Chain [1] done processing
16:39:40 - cmdstanpy - INFO - Chain [1] start processing
16:39:40 - cmdstanpy - INFO - Chain [1] start processing
16:39:40 - cmdstanpy - INFO - Chain [1] start processing
16:39:40 - cmdstanpy - INFO - Chain [1] start processing
16:39:40 - cmdstanpy - INFO - Chain [1] done processing
16:39:40 - cmdstanpy - INFO - Chain [1] done processing
16:39:40 - cmdstanpy - INFO - Chain [1] done processing
16:39:40 - cmdstanpy - INFO - Chain [1] done processing
16:39:40 - cmdstanpy - INFO - Chain [1] start processing
16:39:41 - cmdstanpy - INFO - Chain [1] done processing
16:39:41 - cmdstanpy - INFO - Chain [1] start processing
16:39:41 - cmdstanpy - INFO - Chain [1] start processing
16:39:41 - cmdstanpy - INFO - Chain [1] start processing
16:39:41 - cmdstanpy - INFO - Chain [1] start processing
16:39:42 - cmdstanpy - INFO - Chain [1] done processing
16:39:42 - cmdstanpy - INFO - Chain [1] done processing
16:39:42 - cmdstanpy - INFO - Chain [1] done processing
16:39:42 - cmdstanpy - INFO - Chain [1] done processing
16:39:42 - cmdstanpy - INFO - Chain [1] start processing
16:39:42 - cmdstanpy - INFO - Chain [1] done processing
16:39:43 - cmdstanpy - INFO - Chain [1] start processing
16:39:43 - cmdstanpy - INFO - Chain [1] start processing
16:39:43 - cmdstanpy - INFO - Chain [1] start processing
16:39:43 - cmdstanpy - INFO - Chain [1] start processing
16:39:43 - cmdstanpy - INFO - Chain [1] done processing
16:39:43 - cmdstanpy - INFO - Chain [1] done processing
16:39:43 - cmdstanpy - INFO - Chain [1] done processing
16:39:43 - cmdstanpy - INFO - Chain [1] done processing
16:39:43 - cmdstanpy - INFO - Chain [1] start processing
16:39:44 - cmdstanpy - INFO - Chain [1] done processing
16:39:44 - cmdstanpy - INFO - Chain [1] start processing
16:39:44 - cmdstanpy - INFO - Chain [1] start processing
16:39:44 - cmdstanpy - INFO - Chain [1] start processing
16:39:44 - cmdstanpy - INFO - Chain [1] start processing
16:39:44 - cmdstanpy - INFO - Chain [1] done processing
16:39:44 - cmdstanpy - INFO - Chain [1] done processing
16:39:45 - cmdstanpy - INFO - Chain [1] done processing
16:39:45 - cmdstanpy - INFO - Chain [1] done processing
16:39:45 - cmdstanpy - INFO - Chain [1] start processing
16:39:45 - cmdstanpy - INFO - Chain [1] done processing
16:39:46 - cmdstanpy - INFO - Chain [1] start processing
16:39:46 - cmdstanpy - INFO - Chain [1] start processing
16:39:46 - cmdstanpy - INFO - Chain [1] done processing
16:39:46 - cmdstanpy - INFO - Chain [1] start processing
16:39:46 - cmdstanpy - INFO - Chain [1] start processing
16:39:46 - cmdstanpy - INFO - Chain [1] done processing
16:39:46 - cmdstanpy - INFO - Chain [1] done processing
16:39:46 - cmdstanpy - INFO - Chain [1] done processing
16:39:46 - cmdstanpy - INFO - Chain [1] start processing
16:39:46 - cmdstanpy - INFO - Chain [1] done processing
16:39:47 - cmdstanpy - INFO - Chain [1] start processing
16:39:47 - cmdstanpy - INFO - Chain [1] start processing
16:39:47 - cmdstanpy - INFO - Chain [1] start processing
16:39:47 - cmdstanpy - INFO - Chain [1] start processing
16:39:47 - cmdstanpy - INFO - Chain [1] done processing
16:39:47 - cmdstanpy - INFO - Chain [1] done processing
16:39:47 - cmdstanpy - INFO - Chain [1] done processing
16:39:48 - cmdstanpy - INFO - Chain [1] done processing
16:39:48 - cmdstanpy - INFO - Chain [1] start processing
16:39:48 - cmdstanpy - INFO - Chain [1] done processing
16:39:49 - cmdstanpy - INFO - Chain [1] start processing
16:39:49 - cmdstanpy - INFO - Chain [1] start processing
16:39:49 - cmdstanpy - INFO - Chain [1] start processing
16:39:49 - cmdstanpy - INFO - Chain [1] start processing
16:39:49 - cmdstanpy - INFO - Chain [1] done processing
16:39:49 - cmdstanpy - INFO - Chain [1] done processing
16:39:49 - cmdstanpy - INFO - Chain [1] done processing
16:39:49 - cmdstanpy - INFO - Chain [1] done processing
16:39:49 - cmdstanpy - INFO - Chain [1] start processing
16:39:49 - cmdstanpy - INFO - Chain [1] done processing
16:39:50 - cmdstanpy - INFO - Chain [1] start processing
16:39:50 - cmdstanpy - INFO - Chain [1] start processing
16:39:50 - cmdstanpy - INFO - Chain [1] done processing
16:39:50 - cmdstanpy - INFO - Chain [1] start processing
16:39:50 - cmdstanpy - INFO - Chain [1] done processing
16:39:50 - cmdstanpy - INFO - Chain [1] start processing
16:39:50 - cmdstanpy - INFO - Chain [1] done processing
16:39:50 - cmdstanpy - INFO - Chain [1] done processing
16:39:50 - cmdstanpy - INFO - Chain [1] start processing
16:39:51 - cmdstanpy - INFO - Chain [1] done processing
16:39:52 - cmdstanpy - INFO - Chain [1] start processing
16:39:52 - cmdstanpy - INFO - Chain [1] start processing
16:39:52 - cmdstanpy - INFO - Chain [1] start processing
16:39:52 - cmdstanpy - INFO - Chain [1] start processing
16:39:52 - cmdstanpy - INFO - Chain [1] done processing
16:39:52 - cmdstanpy - INFO - Chain [1] done processing
16:39:52 - cmdstanpy - INFO - Chain [1] done processing
16:39:52 - cmdstanpy - INFO - Chain [1] done processing
16:39:52 - cmdstanpy - INFO - Chain [1] start processing
16:39:52 - cmdstanpy - INFO - Chain [1] done processing
16:39:53 - cmdstanpy - INFO - Chain [1] start processing
16:39:53 - cmdstanpy - INFO - Chain [1] start processing
16:39:53 - cmdstanpy - INFO - Chain [1] done processing
16:39:53 - cmdstanpy - INFO - Chain [1] start processing
16:39:53 - cmdstanpy - INFO - Chain [1] start processing
16:39:53 - cmdstanpy - INFO - Chain [1] done processing
16:39:53 - cmdstanpy - INFO - Chain [1] done processing
16:39:53 - cmdstanpy - INFO - Chain [1] done processing
16:39:53 - cmdstanpy - INFO - Chain [1] start processing
16:39:54 - cmdstanpy - INFO - Chain [1] done processing
16:39:54 - cmdstanpy - INFO - Chain [1] start processing
16:39:54 - cmdstanpy - INFO - Chain [1] start processing
16:39:54 - cmdstanpy - INFO - Chain [1] start processing
16:39:54 - cmdstanpy - INFO - Chain [1] start processing
16:39:55 - cmdstanpy - INFO - Chain [1] done processing
16:39:55 - cmdstanpy - INFO - Chain [1] done processing
16:39:55 - cmdstanpy - INFO - Chain [1] done processing
16:39:55 - cmdstanpy - INFO - Chain [1] done processing
16:39:55 - cmdstanpy - INFO - Chain [1] start processing
16:39:55 - cmdstanpy - INFO - Chain [1] done processing
16:39:56 - cmdstanpy - INFO - Chain [1] start processing
16:39:56 - cmdstanpy - INFO - Chain [1] start processing
16:39:56 - cmdstanpy - INFO - Chain [1] start processing
16:39:56 - cmdstanpy - INFO - Chain [1] start processing
16:39:56 - cmdstanpy - INFO - Chain [1] done processing
16:39:56 - cmdstanpy - INFO - Chain [1] done processing
16:39:56 - cmdstanpy - INFO - Chain [1] done processing
16:39:56 - cmdstanpy - INFO - Chain [1] done processing
16:39:56 - cmdstanpy - INFO - Chain [1] start processing
16:39:56 - cmdstanpy - INFO - Chain [1] done processing
16:39:57 - cmdstanpy - INFO - Chain [1] start processing
16:39:57 - cmdstanpy - INFO - Chain [1] start processing
16:39:57 - cmdstanpy - INFO - Chain [1] start processing
16:39:57 - cmdstanpy - INFO - Chain [1] start processing
16:39:57 - cmdstanpy - INFO - Chain [1] done processing
16:39:57 - cmdstanpy - INFO - Chain [1] done processing
16:39:57 - cmdstanpy - INFO - Chain [1] done processing
16:39:58 - cmdstanpy - INFO - Chain [1] done processing
16:39:58 - cmdstanpy - INFO - Chain [1] start processing
16:39:58 - cmdstanpy - INFO - Chain [1] done processing
16:39:59 - cmdstanpy - INFO - Chain [1] start processing
16:39:59 - cmdstanpy - INFO - Chain [1] start processing
16:39:59 - cmdstanpy - INFO - Chain [1] start processing
16:39:59 - cmdstanpy - INFO - Chain [1] start processing
16:39:59 - cmdstanpy - INFO - Chain [1] done processing
16:39:59 - cmdstanpy - INFO - Chain [1] done processing
16:39:59 - cmdstanpy - INFO - Chain [1] done processing
16:39:59 - cmdstanpy - INFO - Chain [1] done processing
16:39:59 - cmdstanpy - INFO - Chain [1] start processing
16:39:59 - cmdstanpy - INFO - Chain [1] done processing
16:40:00 - cmdstanpy - INFO - Chain [1] start processing
16:40:00 - cmdstanpy - INFO - Chain [1] start processing
16:40:00 - cmdstanpy - INFO - Chain [1] start processing
16:40:00 - cmdstanpy - INFO - Chain [1] start processing
16:40:00 - cmdstanpy - INFO - Chain [1] done processing
16:40:00 - cmdstanpy - INFO - Chain [1] done processing
16:40:00 - cmdstanpy - INFO - Chain [1] done processing
16:40:00 - cmdstanpy - INFO - Chain [1] done processing
16:40:00 - cmdstanpy - INFO - Chain [1] start processing
16:40:01 - cmdstanpy - INFO - Chain [1] done processing
16:40:02 - cmdstanpy - INFO - Chain [1] start processing
16:40:02 - cmdstanpy - INFO - Chain [1] start processing
16:40:02 - cmdstanpy - INFO - Chain [1] start processing
16:40:02 - cmdstanpy - INFO - Chain [1] start processing
16:40:02 - cmdstanpy - INFO - Chain [1] done processing
16:40:03 - cmdstanpy - INFO - Chain [1] done processing
16:40:03 - cmdstanpy - INFO - Chain [1] done processing
16:40:03 - cmdstanpy - INFO - Chain [1] done processing
16:40:03 - cmdstanpy - INFO - Chain [1] start processing
16:40:04 - cmdstanpy - INFO - Chain [1] done processing
16:40:04 - cmdstanpy - INFO - Chain [1] start processing
16:40:05 - cmdstanpy - INFO - Chain [1] start processing
16:40:05 - cmdstanpy - INFO - Chain [1] start processing
16:40:05 - cmdstanpy - INFO - Chain [1] start processing
16:40:05 - cmdstanpy - INFO - Chain [1] done processing
16:40:05 - cmdstanpy - INFO - Chain [1] done processing
16:40:05 - cmdstanpy - INFO - Chain [1] done processing
16:40:05 - cmdstanpy - INFO - Chain [1] done processing
16:40:05 - cmdstanpy - INFO - Chain [1] start processing
16:40:06 - cmdstanpy - INFO - Chain [1] done processing
16:40:07 - cmdstanpy - INFO - Chain [1] start processing
16:40:07 - cmdstanpy - INFO - Chain [1] start processing
16:40:07 - cmdstanpy - INFO - Chain [1] start processing
16:40:07 - cmdstanpy - INFO - Chain [1] start processing
16:40:07 - cmdstanpy - INFO - Chain [1] done processing
16:40:07 - cmdstanpy - INFO - Chain [1] done processing
16:40:07 - cmdstanpy - INFO - Chain [1] done processing
16:40:07 - cmdstanpy - INFO - Chain [1] done processing
16:40:08 - cmdstanpy - INFO - Chain [1] start processing
16:40:08 - cmdstanpy - INFO - Chain [1] done processing
16:40:09 - cmdstanpy - INFO - Chain [1] start processing
16:40:09 - cmdstanpy - INFO - Chain [1] start processing
16:40:09 - cmdstanpy - INFO - Chain [1] start processing
16:40:09 - cmdstanpy - INFO - Chain [1] start processing
16:40:09 - cmdstanpy - INFO - Chain [1] done processing
16:40:10 - cmdstanpy - INFO - Chain [1] done processing
16:40:10 - cmdstanpy - INFO - Chain [1] done processing
16:40:10 - cmdstanpy - INFO - Chain [1] done processing
16:40:10 - cmdstanpy - INFO - Chain [1] start processing
16:40:11 - cmdstanpy - INFO - Chain [1] done processing
16:40:11 - cmdstanpy - INFO - Chain [1] start processing
16:40:11 - cmdstanpy - INFO - Chain [1] start processing
16:40:11 - cmdstanpy - INFO - Chain [1] start processing
16:40:11 - cmdstanpy - INFO - Chain [1] start processing
16:40:12 - cmdstanpy - INFO - Chain [1] done processing
16:40:12 - cmdstanpy - INFO - Chain [1] done processing
16:40:12 - cmdstanpy - INFO - Chain [1] done processing
16:40:12 - cmdstanpy - INFO - Chain [1] done processing
16:40:12 - cmdstanpy - INFO - Chain [1] start processing
16:40:13 - cmdstanpy - INFO - Chain [1] done processing
16:40:14 - cmdstanpy - INFO - Chain [1] start processing
16:40:14 - cmdstanpy - INFO - Chain [1] start processing
16:40:14 - cmdstanpy - INFO - Chain [1] start processing
16:40:14 - cmdstanpy - INFO - Chain [1] start processing
16:40:14 - cmdstanpy - INFO - Chain [1] done processing
16:40:14 - cmdstanpy - INFO - Chain [1] done processing
16:40:14 - cmdstanpy - INFO - Chain [1] done processing
16:40:14 - cmdstanpy - INFO - Chain [1] done processing
16:40:14 - cmdstanpy - INFO - Chain [1] start processing
16:40:15 - cmdstanpy - INFO - Chain [1] done processing
16:40:16 - cmdstanpy - INFO - Chain [1] start processing
16:40:16 - cmdstanpy - INFO - Chain [1] start processing
16:40:16 - cmdstanpy - INFO - Chain [1] start processing
16:40:16 - cmdstanpy - INFO - Chain [1] start processing
16:40:16 - cmdstanpy - INFO - Chain [1] done processing
16:40:17 - cmdstanpy - INFO - Chain [1] done processing
16:40:17 - cmdstanpy - INFO - Chain [1] done processing
16:40:17 - cmdstanpy - INFO - Chain [1] done processing
16:40:17 - cmdstanpy - INFO - Chain [1] start processing
16:40:17 - cmdstanpy - INFO - Chain [1] done processing
16:40:18 - cmdstanpy - INFO - Chain [1] start processing
16:40:18 - cmdstanpy - INFO - Chain [1] start processing
16:40:18 - cmdstanpy - INFO - Chain [1] start processing
16:40:18 - cmdstanpy - INFO - Chain [1] start processing
16:40:19 - cmdstanpy - INFO - Chain [1] done processing
16:40:19 - cmdstanpy - INFO - Chain [1] done processing
16:40:19 - cmdstanpy - INFO - Chain [1] done processing
16:40:19 - cmdstanpy - INFO - Chain [1] done processing
16:40:19 - cmdstanpy - INFO - Chain [1] start processing
16:40:20 - cmdstanpy - INFO - Chain [1] done processing
16:40:21 - cmdstanpy - INFO - Chain [1] start processing
16:40:21 - cmdstanpy - INFO - Chain [1] start processing
16:40:21 - cmdstanpy - INFO - Chain [1] start processing
16:40:21 - cmdstanpy - INFO - Chain [1] start processing
16:40:21 - cmdstanpy - INFO - Chain [1] done processing
16:40:21 - cmdstanpy - INFO - Chain [1] done processing
16:40:21 - cmdstanpy - INFO - Chain [1] done processing
16:40:21 - cmdstanpy - INFO - Chain [1] done processing
16:40:21 - cmdstanpy - INFO - Chain [1] start processing
16:40:22 - cmdstanpy - INFO - Chain [1] done processing
16:40:23 - cmdstanpy - INFO - Chain [1] start processing
16:40:23 - cmdstanpy - INFO - Chain [1] start processing
16:40:23 - cmdstanpy - INFO - Chain [1] start processing
16:40:23 - cmdstanpy - INFO - Chain [1] start processing
16:40:23 - cmdstanpy - INFO - Chain [1] done processing
16:40:24 - cmdstanpy - INFO - Chain [1] done processing
16:40:24 - cmdstanpy - INFO - Chain [1] done processing
16:40:24 - cmdstanpy - INFO - Chain [1] done processing
16:40:24 - cmdstanpy - INFO - Chain [1] start processing
16:40:25 - cmdstanpy - INFO - Chain [1] done processing
16:40:25 - cmdstanpy - INFO - Chain [1] start processing
16:40:25 - cmdstanpy - INFO - Chain [1] start processing
16:40:25 - cmdstanpy - INFO - Chain [1] start processing
16:40:25 - cmdstanpy - INFO - Chain [1] start processing
16:40:26 - cmdstanpy - INFO - Chain [1] done processing
16:40:26 - cmdstanpy - INFO - Chain [1] done processing
16:40:26 - cmdstanpy - INFO - Chain [1] done processing
16:40:26 - cmdstanpy - INFO - Chain [1] done processing
16:40:26 - cmdstanpy - INFO - Chain [1] start processing
16:40:27 - cmdstanpy - INFO - Chain [1] done processing
16:40:28 - cmdstanpy - INFO - Chain [1] start processing
16:40:28 - cmdstanpy - INFO - Chain [1] start processing
16:40:28 - cmdstanpy - INFO - Chain [1] start processing
16:40:28 - cmdstanpy - INFO - Chain [1] start processing
16:40:28 - cmdstanpy - INFO - Chain [1] done processing
16:40:28 - cmdstanpy - INFO - Chain [1] done processing
16:40:28 - cmdstanpy - INFO - Chain [1] done processing
16:40:28 - cmdstanpy - INFO - Chain [1] done processing
16:40:29 - cmdstanpy - INFO - Chain [1] start processing
16:40:29 - cmdstanpy - INFO - Chain [1] done processing
16:40:30 - cmdstanpy - INFO - Chain [1] start processing
16:40:30 - cmdstanpy - INFO - Chain [1] start processing
16:40:30 - cmdstanpy - INFO - Chain [1] start processing
16:40:30 - cmdstanpy - INFO - Chain [1] start processing
16:40:30 - cmdstanpy - INFO - Chain [1] done processing
16:40:31 - cmdstanpy - INFO - Chain [1] done processing
16:40:31 - cmdstanpy - INFO - Chain [1] done processing
16:40:31 - cmdstanpy - INFO - Chain [1] done processing
16:40:31 - cmdstanpy - INFO - Chain [1] start processing
16:40:32 - cmdstanpy - INFO - Chain [1] done processing
16:40:32 - cmdstanpy - INFO - Chain [1] start processing
16:40:32 - cmdstanpy - INFO - Chain [1] start processing
16:40:32 - cmdstanpy - INFO - Chain [1] start processing
16:40:32 - cmdstanpy - INFO - Chain [1] start processing
16:40:33 - cmdstanpy - INFO - Chain [1] done processing
16:40:33 - cmdstanpy - INFO - Chain [1] done processing
16:40:33 - cmdstanpy - INFO - Chain [1] done processing
16:40:33 - cmdstanpy - INFO - Chain [1] done processing
16:40:33 - cmdstanpy - INFO - Chain [1] start processing
16:40:34 - cmdstanpy - INFO - Chain [1] done processing
16:40:35 - cmdstanpy - INFO - Chain [1] start processing
16:40:35 - cmdstanpy - INFO - Chain [1] start processing
16:40:35 - cmdstanpy - INFO - Chain [1] start processing
16:40:35 - cmdstanpy - INFO - Chain [1] start processing
16:40:35 - cmdstanpy - INFO - Chain [1] done processing
16:40:35 - cmdstanpy - INFO - Chain [1] done processing
16:40:35 - cmdstanpy - INFO - Chain [1] done processing
16:40:35 - cmdstanpy - INFO - Chain [1] done processing
16:40:35 - cmdstanpy - INFO - Chain [1] start processing
16:40:36 - cmdstanpy - INFO - Chain [1] done processing
16:40:37 - cmdstanpy - INFO - Chain [1] start processing
16:40:37 - cmdstanpy - INFO - Chain [1] start processing
16:40:37 - cmdstanpy - INFO - Chain [1] start processing
16:40:37 - cmdstanpy - INFO - Chain [1] start processing
16:40:37 - cmdstanpy - INFO - Chain [1] done processing
16:40:37 - cmdstanpy - INFO - Chain [1] done processing
16:40:38 - cmdstanpy - INFO - Chain [1] done processing
16:40:38 - cmdstanpy - INFO - Chain [1] done processing
16:40:38 - cmdstanpy - INFO - Chain [1] start processing
16:40:38 - cmdstanpy - INFO - Chain [1] done processing
16:40:39 - cmdstanpy - INFO - Chain [1] start processing
16:40:39 - cmdstanpy - INFO - Chain [1] start processing
16:40:39 - cmdstanpy - INFO - Chain [1] start processing
16:40:39 - cmdstanpy - INFO - Chain [1] start processing
16:40:39 - cmdstanpy - INFO - Chain [1] done processing
16:40:40 - cmdstanpy - INFO - Chain [1] done processing
16:40:40 - cmdstanpy - INFO - Chain [1] done processing
16:40:40 - cmdstanpy - INFO - Chain [1] done processing
16:40:40 - cmdstanpy - INFO - Chain [1] start processing
16:40:41 - cmdstanpy - INFO - Chain [1] done processing
16:40:42 - cmdstanpy - INFO - Chain [1] start processing
16:40:42 - cmdstanpy - INFO - Chain [1] start processing
16:40:42 - cmdstanpy - INFO - Chain [1] start processing
16:40:42 - cmdstanpy - INFO - Chain [1] start processing
16:40:42 - cmdstanpy - INFO - Chain [1] done processing
16:40:42 - cmdstanpy - INFO - Chain [1] done processing
16:40:42 - cmdstanpy - INFO - Chain [1] done processing
16:40:42 - cmdstanpy - INFO - Chain [1] done processing
16:40:42 - cmdstanpy - INFO - Chain [1] start processing
16:40:43 - cmdstanpy - INFO - Chain [1] done processing
16:40:44 - cmdstanpy - INFO - Chain [1] start processing
16:40:44 - cmdstanpy - INFO - Chain [1] start processing
16:40:44 - cmdstanpy - INFO - Chain [1] start processing
16:40:44 - cmdstanpy - INFO - Chain [1] start processing
16:40:44 - cmdstanpy - INFO - Chain [1] done processing
16:40:45 - cmdstanpy - INFO - Chain [1] done processing
16:40:45 - cmdstanpy - INFO - Chain [1] done processing
16:40:45 - cmdstanpy - INFO - Chain [1] done processing
16:40:45 - cmdstanpy - INFO - Chain [1] start processing
16:40:46 - cmdstanpy - INFO - Chain [1] done processing
16:40:46 - cmdstanpy - INFO - Chain [1] start processing
16:40:47 - cmdstanpy - INFO - Chain [1] start processing
16:40:47 - cmdstanpy - INFO - Chain [1] start processing
16:40:47 - cmdstanpy - INFO - Chain [1] start processing
16:40:47 - cmdstanpy - INFO - Chain [1] done processing
16:40:47 - cmdstanpy - INFO - Chain [1] done processing
16:40:47 - cmdstanpy - INFO - Chain [1] done processing
16:40:47 - cmdstanpy - INFO - Chain [1] done processing
16:40:47 - cmdstanpy - INFO - Chain [1] start processing
16:40:48 - cmdstanpy - INFO - Chain [1] done processing
16:40:49 - cmdstanpy - INFO - Chain [1] start processing
16:40:49 - cmdstanpy - INFO - Chain [1] start processing
16:40:49 - cmdstanpy - INFO - Chain [1] start processing
16:40:49 - cmdstanpy - INFO - Chain [1] start processing
16:40:49 - cmdstanpy - INFO - Chain [1] done processing
16:40:49 - cmdstanpy - INFO - Chain [1] done processing
16:40:49 - cmdstanpy - INFO - Chain [1] done processing
16:40:49 - cmdstanpy - INFO - Chain [1] done processing
16:40:49 - cmdstanpy - INFO - Chain [1] start processing
16:40:50 - cmdstanpy - INFO - Chain [1] done processing
16:40:51 - cmdstanpy - INFO - Chain [1] start processing
16:40:51 - cmdstanpy - INFO - Chain [1] start processing
16:40:51 - cmdstanpy - INFO - Chain [1] start processing
16:40:51 - cmdstanpy - INFO - Chain [1] start processing
16:40:51 - cmdstanpy - INFO - Chain [1] done processing
16:40:52 - cmdstanpy - INFO - Chain [1] done processing
16:40:52 - cmdstanpy - INFO - Chain [1] done processing
16:40:52 - cmdstanpy - INFO - Chain [1] done processing
16:40:52 - cmdstanpy - INFO - Chain [1] start processing
16:40:53 - cmdstanpy - INFO - Chain [1] done processing
16:40:53 - cmdstanpy - INFO - Chain [1] start processing
16:40:53 - cmdstanpy - INFO - Chain [1] start processing
16:40:54 - cmdstanpy - INFO - Chain [1] start processing
16:40:54 - cmdstanpy - INFO - Chain [1] start processing
16:40:54 - cmdstanpy - INFO - Chain [1] done processing
16:40:54 - cmdstanpy - INFO - Chain [1] done processing
16:40:54 - cmdstanpy - INFO - Chain [1] done processing
16:40:54 - cmdstanpy - INFO - Chain [1] done processing
16:40:54 - cmdstanpy - INFO - Chain [1] start processing
16:40:55 - cmdstanpy - INFO - Chain [1] done processing
16:40:56 - cmdstanpy - INFO - Chain [1] start processing
16:40:56 - cmdstanpy - INFO - Chain [1] start processing
16:40:56 - cmdstanpy - INFO - Chain [1] start processing
16:40:56 - cmdstanpy - INFO - Chain [1] start processing
16:40:56 - cmdstanpy - INFO - Chain [1] done processing
16:40:56 - cmdstanpy - INFO - Chain [1] done processing
16:40:56 - cmdstanpy - INFO - Chain [1] done processing
16:40:56 - cmdstanpy - INFO - Chain [1] done processing
16:40:56 - cmdstanpy - INFO - Chain [1] start processing
16:40:57 - cmdstanpy - INFO - Chain [1] done processing
16:40:58 - cmdstanpy - INFO - Chain [1] start processing
16:40:58 - cmdstanpy - INFO - Chain [1] start processing
16:40:58 - cmdstanpy - INFO - Chain [1] start processing
16:40:58 - cmdstanpy - INFO - Chain [1] start processing
16:40:58 - cmdstanpy - INFO - Chain [1] done processing
16:40:59 - cmdstanpy - INFO - Chain [1] done processing
16:40:59 - cmdstanpy - INFO - Chain [1] done processing
16:40:59 - cmdstanpy - INFO - Chain [1] done processing
16:40:59 - cmdstanpy - INFO - Chain [1] start processing
16:41:00 - cmdstanpy - INFO - Chain [1] done processing
16:41:00 - cmdstanpy - INFO - Chain [1] start processing
16:41:01 - cmdstanpy - INFO - Chain [1] start processing
16:41:01 - cmdstanpy - INFO - Chain [1] start processing
16:41:01 - cmdstanpy - INFO - Chain [1] start processing
16:41:01 - cmdstanpy - INFO - Chain [1] done processing
16:41:01 - cmdstanpy - INFO - Chain [1] done processing
16:41:01 - cmdstanpy - INFO - Chain [1] done processing
16:41:01 - cmdstanpy - INFO - Chain [1] done processing
16:41:01 - cmdstanpy - INFO - Chain [1] start processing
16:41:02 - cmdstanpy - INFO - Chain [1] done processing
16:41:03 - cmdstanpy - INFO - Chain [1] start processing
16:41:03 - cmdstanpy - INFO - Chain [1] start processing
16:41:03 - cmdstanpy - INFO - Chain [1] start processing
16:41:03 - cmdstanpy - INFO - Chain [1] start processing
16:41:03 - cmdstanpy - INFO - Chain [1] done processing
16:41:03 - cmdstanpy - INFO - Chain [1] done processing
16:41:03 - cmdstanpy - INFO - Chain [1] done processing
16:41:03 - cmdstanpy - INFO - Chain [1] done processing
16:41:04 - cmdstanpy - INFO - Chain [1] start processing
16:41:04 - cmdstanpy - INFO - Chain [1] done processing
16:41:05 - cmdstanpy - INFO - Chain [1] start processing
16:41:05 - cmdstanpy - INFO - Chain [1] start processing
16:41:05 - cmdstanpy - INFO - Chain [1] start processing
16:41:05 - cmdstanpy - INFO - Chain [1] start processing
16:41:05 - cmdstanpy - INFO - Chain [1] done processing
16:41:06 - cmdstanpy - INFO - Chain [1] done processing
16:41:06 - cmdstanpy - INFO - Chain [1] done processing
16:41:06 - cmdstanpy - INFO - Chain [1] done processing
16:41:06 - cmdstanpy - INFO - Chain [1] start processing
16:41:07 - cmdstanpy - INFO - Chain [1] done processing
16:41:07 - cmdstanpy - INFO - Chain [1] start processing
16:41:08 - cmdstanpy - INFO - Chain [1] start processing
16:41:08 - cmdstanpy - INFO - Chain [1] start processing
16:41:08 - cmdstanpy - INFO - Chain [1] start processing
16:41:08 - cmdstanpy - INFO - Chain [1] done processing
16:41:08 - cmdstanpy - INFO - Chain [1] done processing
16:41:08 - cmdstanpy - INFO - Chain [1] done processing
16:41:08 - cmdstanpy - INFO - Chain [1] done processing
16:41:08 - cmdstanpy - INFO - Chain [1] start processing
16:41:09 - cmdstanpy - INFO - Chain [1] done processing
16:41:10 - cmdstanpy - INFO - Chain [1] start processing
16:41:10 - cmdstanpy - INFO - Chain [1] start processing
16:41:10 - cmdstanpy - INFO - Chain [1] start processing
16:41:10 - cmdstanpy - INFO - Chain [1] start processing
16:41:10 - cmdstanpy - INFO - Chain [1] done processing
16:41:10 - cmdstanpy - INFO - Chain [1] done processing
16:41:10 - cmdstanpy - INFO - Chain [1] done processing
16:41:10 - cmdstanpy - INFO - Chain [1] done processing
16:41:11 - cmdstanpy - INFO - Chain [1] start processing
16:41:11 - cmdstanpy - INFO - Chain [1] done processing
16:41:12 - cmdstanpy - INFO - Chain [1] start processing
16:41:12 - cmdstanpy - INFO - Chain [1] start processing
16:41:12 - cmdstanpy - INFO - Chain [1] start processing
16:41:12 - cmdstanpy - INFO - Chain [1] start processing
16:41:12 - cmdstanpy - INFO - Chain [1] done processing
16:41:13 - cmdstanpy - INFO - Chain [1] done processing
16:41:13 - cmdstanpy - INFO - Chain [1] done processing
16:41:13 - cmdstanpy - INFO - Chain [1] done processing
16:41:13 - cmdstanpy - INFO - Chain [1] start processing
16:41:14 - cmdstanpy - INFO - Chain [1] done processing
16:41:14 - cmdstanpy - INFO - Chain [1] start processing
16:41:14 - cmdstanpy - INFO - Chain [1] start processing
16:41:14 - cmdstanpy - INFO - Chain [1] start processing
16:41:14 - cmdstanpy - INFO - Chain [1] start processing
16:41:15 - cmdstanpy - INFO - Chain [1] done processing
16:41:15 - cmdstanpy - INFO - Chain [1] done processing
16:41:15 - cmdstanpy - INFO - Chain [1] done processing
16:41:15 - cmdstanpy - INFO - Chain [1] done processing
16:41:15 - cmdstanpy - INFO - Chain [1] start processing

Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'additive'}

16:41:16 - cmdstanpy - INFO - Chain [1] done processing

Test RMSE: 0.012984771707713526

16:41:17 - cmdstanpy - INFO - Chain [1] start processing
16:41:17 - cmdstanpy - INFO - Chain [1] start processing
16:41:17 - cmdstanpy - INFO - Chain [1] start processing
16:41:17 - cmdstanpy - INFO - Chain [1] start processing
16:41:17 - cmdstanpy - INFO - Chain [1] done processing
16:41:17 - cmdstanpy - INFO - Chain [1] done processing
16:41:17 - cmdstanpy - INFO - Chain [1] done processing
16:41:17 - cmdstanpy - INFO - Chain [1] done processing

Cross-Validation RMSE: 0.00508977771402136

I decided to do one more tuning just to be exhaustive.

Code

# Set the logistic growth
train['cap'] = 1  
test['cap'] = 1   

# Initialize and fit the Prophet model on the training data with logistic growth
model = Prophet(growth='logistic')
model.add_country_holidays(country_name='US')
model.fit(train)

# Updated parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.3, 0.4, 0.45, 0.5],
    'seasonality_prior_scale': [0.01, 0.015, 0.02, 0.025],
    'holidays_prior_scale': [0.01, 0.015, 0.02, 0.025]
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    # Initialize Prophet model with logistic growth and additive seasonality
    m = Prophet(growth='logistic', seasonality_mode='additive', **params)
    m.add_country_holidays(country_name='US')
    m.fit(train)
    
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")

# Fit the final model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
final_model.fit(train)

# Predict and evaluate on the test set
future_test = final_model.make_future_dataframe(periods=len(test), freq='W', include_history=False)
# Add the cap to the future dataframe
future_test['cap'] = 1
forecast_test = final_model.predict(future_test)
test_rmse = sqrt(mean_squared_error(test['y'], forecast_test['yhat']))
print(f"Test RMSE: {test_rmse}")

# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

16:42:51 - cmdstanpy - INFO - Chain [1] start processing
16:42:51 - cmdstanpy - INFO - Chain [1] done processing
16:42:51 - cmdstanpy - INFO - Chain [1] start processing
16:42:52 - cmdstanpy - INFO - Chain [1] done processing
16:42:52 - cmdstanpy - INFO - Chain [1] start processing
16:42:53 - cmdstanpy - INFO - Chain [1] done processing
16:42:53 - cmdstanpy - INFO - Chain [1] start processing
16:42:53 - cmdstanpy - INFO - Chain [1] start processing
16:42:53 - cmdstanpy - INFO - Chain [1] start processing
16:42:53 - cmdstanpy - INFO - Chain [1] done processing
16:42:53 - cmdstanpy - INFO - Chain [1] done processing
16:42:53 - cmdstanpy - INFO - Chain [1] done processing
16:42:53 - cmdstanpy - INFO - Chain [1] start processing
16:42:53 - cmdstanpy - INFO - Chain [1] done processing
16:42:54 - cmdstanpy - INFO - Chain [1] start processing
16:42:54 - cmdstanpy - INFO - Chain [1] start processing
16:42:54 - cmdstanpy - INFO - Chain [1] done processing
16:42:54 - cmdstanpy - INFO - Chain [1] start processing
16:42:54 - cmdstanpy - INFO - Chain [1] start processing
16:42:55 - cmdstanpy - INFO - Chain [1] done processing
16:42:55 - cmdstanpy - INFO - Chain [1] done processing
16:42:55 - cmdstanpy - INFO - Chain [1] done processing
16:42:55 - cmdstanpy - INFO - Chain [1] start processing
16:42:55 - cmdstanpy - INFO - Chain [1] done processing
16:42:56 - cmdstanpy - INFO - Chain [1] start processing
16:42:56 - cmdstanpy - INFO - Chain [1] start processing
16:42:56 - cmdstanpy - INFO - Chain [1] start processing
16:42:56 - cmdstanpy - INFO - Chain [1] start processing
16:42:56 - cmdstanpy - INFO - Chain [1] done processing
16:42:56 - cmdstanpy - INFO - Chain [1] done processing
16:42:56 - cmdstanpy - INFO - Chain [1] done processing
16:42:56 - cmdstanpy - INFO - Chain [1] done processing
16:42:56 - cmdstanpy - INFO - Chain [1] start processing
16:42:57 - cmdstanpy - INFO - Chain [1] done processing
16:42:58 - cmdstanpy - INFO - Chain [1] start processing
16:42:58 - cmdstanpy - INFO - Chain [1] start processing
16:42:58 - cmdstanpy - INFO - Chain [1] start processing
16:42:58 - cmdstanpy - INFO - Chain [1] done processing
16:42:58 - cmdstanpy - INFO - Chain [1] start processing
16:42:58 - cmdstanpy - INFO - Chain [1] done processing
16:42:58 - cmdstanpy - INFO - Chain [1] done processing
16:42:58 - cmdstanpy - INFO - Chain [1] done processing
16:42:58 - cmdstanpy - INFO - Chain [1] start processing
16:42:59 - cmdstanpy - INFO - Chain [1] done processing
16:43:00 - cmdstanpy - INFO - Chain [1] start processing
16:43:00 - cmdstanpy - INFO - Chain [1] start processing
16:43:00 - cmdstanpy - INFO - Chain [1] start processing
16:43:00 - cmdstanpy - INFO - Chain [1] start processing
16:43:00 - cmdstanpy - INFO - Chain [1] done processing
16:43:00 - cmdstanpy - INFO - Chain [1] done processing
16:43:00 - cmdstanpy - INFO - Chain [1] done processing
16:43:00 - cmdstanpy - INFO - Chain [1] done processing
16:43:00 - cmdstanpy - INFO - Chain [1] start processing
16:43:00 - cmdstanpy - INFO - Chain [1] done processing
16:43:01 - cmdstanpy - INFO - Chain [1] start processing
16:43:01 - cmdstanpy - INFO - Chain [1] start processing
16:43:01 - cmdstanpy - INFO - Chain [1] start processing
16:43:01 - cmdstanpy - INFO - Chain [1] start processing
16:43:01 - cmdstanpy - INFO - Chain [1] done processing
16:43:02 - cmdstanpy - INFO - Chain [1] done processing
16:43:02 - cmdstanpy - INFO - Chain [1] done processing
16:43:02 - cmdstanpy - INFO - Chain [1] done processing
16:43:02 - cmdstanpy - INFO - Chain [1] start processing
16:43:02 - cmdstanpy - INFO - Chain [1] done processing
16:43:03 - cmdstanpy - INFO - Chain [1] start processing
16:43:03 - cmdstanpy - INFO - Chain [1] start processing
16:43:03 - cmdstanpy - INFO - Chain [1] start processing
16:43:03 - cmdstanpy - INFO - Chain [1] start processing
16:43:03 - cmdstanpy - INFO - Chain [1] done processing
16:43:03 - cmdstanpy - INFO - Chain [1] done processing
16:43:03 - cmdstanpy - INFO - Chain [1] done processing
16:43:03 - cmdstanpy - INFO - Chain [1] done processing
16:43:03 - cmdstanpy - INFO - Chain [1] start processing
16:43:04 - cmdstanpy - INFO - Chain [1] done processing
16:43:05 - cmdstanpy - INFO - Chain [1] start processing
16:43:05 - cmdstanpy - INFO - Chain [1] start processing
16:43:05 - cmdstanpy - INFO - Chain [1] start processing
16:43:05 - cmdstanpy - INFO - Chain [1] start processing
16:43:05 - cmdstanpy - INFO - Chain [1] done processing
16:43:05 - cmdstanpy - INFO - Chain [1] done processing
16:43:05 - cmdstanpy - INFO - Chain [1] done processing
16:43:05 - cmdstanpy - INFO - Chain [1] done processing
16:43:05 - cmdstanpy - INFO - Chain [1] start processing
16:43:06 - cmdstanpy - INFO - Chain [1] done processing
16:43:06 - cmdstanpy - INFO - Chain [1] start processing
16:43:06 - cmdstanpy - INFO - Chain [1] start processing
16:43:07 - cmdstanpy - INFO - Chain [1] start processing
16:43:07 - cmdstanpy - INFO - Chain [1] start processing
16:43:07 - cmdstanpy - INFO - Chain [1] done processing
16:43:07 - cmdstanpy - INFO - Chain [1] done processing
16:43:07 - cmdstanpy - INFO - Chain [1] done processing
16:43:07 - cmdstanpy - INFO - Chain [1] done processing
16:43:07 - cmdstanpy - INFO - Chain [1] start processing
16:43:07 - cmdstanpy - INFO - Chain [1] done processing
16:43:08 - cmdstanpy - INFO - Chain [1] start processing
16:43:08 - cmdstanpy - INFO - Chain [1] start processing
16:43:08 - cmdstanpy - INFO - Chain [1] start processing
16:43:08 - cmdstanpy - INFO - Chain [1] start processing
16:43:08 - cmdstanpy - INFO - Chain [1] done processing
16:43:09 - cmdstanpy - INFO - Chain [1] done processing
16:43:09 - cmdstanpy - INFO - Chain [1] done processing
16:43:09 - cmdstanpy - INFO - Chain [1] done processing
16:43:09 - cmdstanpy - INFO - Chain [1] start processing
16:43:09 - cmdstanpy - INFO - Chain [1] done processing
16:43:10 - cmdstanpy - INFO - Chain [1] start processing
16:43:10 - cmdstanpy - INFO - Chain [1] start processing
16:43:10 - cmdstanpy - INFO - Chain [1] start processing
16:43:10 - cmdstanpy - INFO - Chain [1] done processing
16:43:10 - cmdstanpy - INFO - Chain [1] start processing
16:43:10 - cmdstanpy - INFO - Chain [1] done processing
16:43:10 - cmdstanpy - INFO - Chain [1] done processing
16:43:10 - cmdstanpy - INFO - Chain [1] done processing
16:43:10 - cmdstanpy - INFO - Chain [1] start processing
16:43:11 - cmdstanpy - INFO - Chain [1] done processing
16:43:12 - cmdstanpy - INFO - Chain [1] start processing
16:43:12 - cmdstanpy - INFO - Chain [1] start processing
16:43:12 - cmdstanpy - INFO - Chain [1] start processing
16:43:12 - cmdstanpy - INFO - Chain [1] start processing
16:43:12 - cmdstanpy - INFO - Chain [1] done processing
16:43:12 - cmdstanpy - INFO - Chain [1] done processing
16:43:12 - cmdstanpy - INFO - Chain [1] done processing
16:43:12 - cmdstanpy - INFO - Chain [1] done processing
16:43:12 - cmdstanpy - INFO - Chain [1] start processing
16:43:13 - cmdstanpy - INFO - Chain [1] done processing
16:43:13 - cmdstanpy - INFO - Chain [1] start processing
16:43:13 - cmdstanpy - INFO - Chain [1] start processing
16:43:13 - cmdstanpy - INFO - Chain [1] start processing
16:43:13 - cmdstanpy - INFO - Chain [1] start processing
16:43:14 - cmdstanpy - INFO - Chain [1] done processing
16:43:14 - cmdstanpy - INFO - Chain [1] done processing
16:43:14 - cmdstanpy - INFO - Chain [1] done processing
16:43:14 - cmdstanpy - INFO - Chain [1] done processing
16:43:14 - cmdstanpy - INFO - Chain [1] start processing
16:43:14 - cmdstanpy - INFO - Chain [1] done processing
16:43:15 - cmdstanpy - INFO - Chain [1] start processing
16:43:15 - cmdstanpy - INFO - Chain [1] start processing
16:43:15 - cmdstanpy - INFO - Chain [1] start processing
16:43:15 - cmdstanpy - INFO - Chain [1] start processing
16:43:15 - cmdstanpy - INFO - Chain [1] done processing
16:43:15 - cmdstanpy - INFO - Chain [1] done processing
16:43:15 - cmdstanpy - INFO - Chain [1] done processing
16:43:16 - cmdstanpy - INFO - Chain [1] done processing
16:43:16 - cmdstanpy - INFO - Chain [1] start processing
16:43:16 - cmdstanpy - INFO - Chain [1] done processing
16:43:17 - cmdstanpy - INFO - Chain [1] start processing
16:43:17 - cmdstanpy - INFO - Chain [1] start processing
16:43:17 - cmdstanpy - INFO - Chain [1] start processing
16:43:17 - cmdstanpy - INFO - Chain [1] start processing
16:43:17 - cmdstanpy - INFO - Chain [1] done processing
16:43:17 - cmdstanpy - INFO - Chain [1] done processing
16:43:17 - cmdstanpy - INFO - Chain [1] done processing
16:43:17 - cmdstanpy - INFO - Chain [1] done processing
16:43:17 - cmdstanpy - INFO - Chain [1] start processing
16:43:18 - cmdstanpy - INFO - Chain [1] done processing
16:43:18 - cmdstanpy - INFO - Chain [1] start processing
16:43:19 - cmdstanpy - INFO - Chain [1] start processing
16:43:19 - cmdstanpy - INFO - Chain [1] start processing
16:43:19 - cmdstanpy - INFO - Chain [1] start processing
16:43:19 - cmdstanpy - INFO - Chain [1] done processing
16:43:19 - cmdstanpy - INFO - Chain [1] done processing
16:43:19 - cmdstanpy - INFO - Chain [1] done processing
16:43:19 - cmdstanpy - INFO - Chain [1] done processing
16:43:19 - cmdstanpy - INFO - Chain [1] start processing
16:43:20 - cmdstanpy - INFO - Chain [1] done processing
16:43:20 - cmdstanpy - INFO - Chain [1] start processing
16:43:20 - cmdstanpy - INFO - Chain [1] start processing
16:43:20 - cmdstanpy - INFO - Chain [1] start processing
16:43:20 - cmdstanpy - INFO - Chain [1] start processing
16:43:21 - cmdstanpy - INFO - Chain [1] done processing
16:43:21 - cmdstanpy - INFO - Chain [1] done processing
16:43:21 - cmdstanpy - INFO - Chain [1] done processing
16:43:21 - cmdstanpy - INFO - Chain [1] done processing
16:43:21 - cmdstanpy - INFO - Chain [1] start processing
16:43:22 - cmdstanpy - INFO - Chain [1] done processing
16:43:23 - cmdstanpy - INFO - Chain [1] start processing
16:43:23 - cmdstanpy - INFO - Chain [1] start processing
16:43:23 - cmdstanpy - INFO - Chain [1] start processing
16:43:23 - cmdstanpy - INFO - Chain [1] start processing
16:43:23 - cmdstanpy - INFO - Chain [1] done processing
16:43:23 - cmdstanpy - INFO - Chain [1] done processing
16:43:23 - cmdstanpy - INFO - Chain [1] done processing
16:43:23 - cmdstanpy - INFO - Chain [1] done processing
16:43:23 - cmdstanpy - INFO - Chain [1] start processing
16:43:24 - cmdstanpy - INFO - Chain [1] done processing
16:43:25 - cmdstanpy - INFO - Chain [1] start processing
16:43:25 - cmdstanpy - INFO - Chain [1] start processing
16:43:25 - cmdstanpy - INFO - Chain [1] start processing
16:43:25 - cmdstanpy - INFO - Chain [1] start processing
16:43:25 - cmdstanpy - INFO - Chain [1] done processing
16:43:25 - cmdstanpy - INFO - Chain [1] done processing
16:43:25 - cmdstanpy - INFO - Chain [1] done processing
16:43:26 - cmdstanpy - INFO - Chain [1] done processing
16:43:26 - cmdstanpy - INFO - Chain [1] start processing
16:43:26 - cmdstanpy - INFO - Chain [1] done processing
16:43:27 - cmdstanpy - INFO - Chain [1] start processing
16:43:27 - cmdstanpy - INFO - Chain [1] start processing
16:43:27 - cmdstanpy - INFO - Chain [1] start processing
16:43:27 - cmdstanpy - INFO - Chain [1] start processing
16:43:27 - cmdstanpy - INFO - Chain [1] done processing
16:43:27 - cmdstanpy - INFO - Chain [1] done processing
16:43:27 - cmdstanpy - INFO - Chain [1] done processing
16:43:28 - cmdstanpy - INFO - Chain [1] done processing
16:43:28 - cmdstanpy - INFO - Chain [1] start processing
16:43:28 - cmdstanpy - INFO - Chain [1] done processing
16:43:29 - cmdstanpy - INFO - Chain [1] start processing
16:43:29 - cmdstanpy - INFO - Chain [1] start processing
16:43:29 - cmdstanpy - INFO - Chain [1] start processing
16:43:29 - cmdstanpy - INFO - Chain [1] start processing
16:43:29 - cmdstanpy - INFO - Chain [1] done processing
16:43:30 - cmdstanpy - INFO - Chain [1] done processing
16:43:30 - cmdstanpy - INFO - Chain [1] done processing
16:43:30 - cmdstanpy - INFO - Chain [1] done processing
16:43:30 - cmdstanpy - INFO - Chain [1] start processing
16:43:31 - cmdstanpy - INFO - Chain [1] done processing
16:43:32 - cmdstanpy - INFO - Chain [1] start processing
16:43:32 - cmdstanpy - INFO - Chain [1] start processing
16:43:32 - cmdstanpy - INFO - Chain [1] start processing
16:43:32 - cmdstanpy - INFO - Chain [1] start processing
16:43:32 - cmdstanpy - INFO - Chain [1] done processing
16:43:32 - cmdstanpy - INFO - Chain [1] done processing
16:43:32 - cmdstanpy - INFO - Chain [1] done processing
16:43:32 - cmdstanpy - INFO - Chain [1] done processing
16:43:32 - cmdstanpy - INFO - Chain [1] start processing
16:43:33 - cmdstanpy - INFO - Chain [1] done processing
16:43:34 - cmdstanpy - INFO - Chain [1] start processing
16:43:34 - cmdstanpy - INFO - Chain [1] start processing
16:43:34 - cmdstanpy - INFO - Chain [1] start processing
16:43:34 - cmdstanpy - INFO - Chain [1] start processing
16:43:34 - cmdstanpy - INFO - Chain [1] done processing
16:43:34 - cmdstanpy - INFO - Chain [1] done processing
16:43:34 - cmdstanpy - INFO - Chain [1] done processing
16:43:35 - cmdstanpy - INFO - Chain [1] done processing
16:43:35 - cmdstanpy - INFO - Chain [1] start processing
16:43:35 - cmdstanpy - INFO - Chain [1] done processing
16:43:36 - cmdstanpy - INFO - Chain [1] start processing
16:43:36 - cmdstanpy - INFO - Chain [1] start processing
16:43:36 - cmdstanpy - INFO - Chain [1] start processing
16:43:36 - cmdstanpy - INFO - Chain [1] start processing
16:43:36 - cmdstanpy - INFO - Chain [1] done processing
16:43:36 - cmdstanpy - INFO - Chain [1] done processing
16:43:36 - cmdstanpy - INFO - Chain [1] done processing
16:43:37 - cmdstanpy - INFO - Chain [1] done processing
16:43:37 - cmdstanpy - INFO - Chain [1] start processing
16:43:37 - cmdstanpy - INFO - Chain [1] done processing
16:43:38 - cmdstanpy - INFO - Chain [1] start processing
16:43:38 - cmdstanpy - INFO - Chain [1] start processing
16:43:38 - cmdstanpy - INFO - Chain [1] start processing
16:43:38 - cmdstanpy - INFO - Chain [1] start processing
16:43:38 - cmdstanpy - INFO - Chain [1] done processing
16:43:39 - cmdstanpy - INFO - Chain [1] done processing
16:43:39 - cmdstanpy - INFO - Chain [1] done processing
16:43:39 - cmdstanpy - INFO - Chain [1] done processing
16:43:39 - cmdstanpy - INFO - Chain [1] start processing
16:43:40 - cmdstanpy - INFO - Chain [1] done processing
16:43:41 - cmdstanpy - INFO - Chain [1] start processing
16:43:41 - cmdstanpy - INFO - Chain [1] start processing
16:43:41 - cmdstanpy - INFO - Chain [1] start processing
16:43:41 - cmdstanpy - INFO - Chain [1] start processing
16:43:41 - cmdstanpy - INFO - Chain [1] done processing
16:43:41 - cmdstanpy - INFO - Chain [1] done processing
16:43:41 - cmdstanpy - INFO - Chain [1] done processing
16:43:41 - cmdstanpy - INFO - Chain [1] done processing
16:43:41 - cmdstanpy - INFO - Chain [1] start processing
16:43:42 - cmdstanpy - INFO - Chain [1] done processing
16:43:43 - cmdstanpy - INFO - Chain [1] start processing
16:43:43 - cmdstanpy - INFO - Chain [1] start processing
16:43:43 - cmdstanpy - INFO - Chain [1] start processing
16:43:43 - cmdstanpy - INFO - Chain [1] start processing
16:43:43 - cmdstanpy - INFO - Chain [1] done processing
16:43:43 - cmdstanpy - INFO - Chain [1] done processing
16:43:43 - cmdstanpy - INFO - Chain [1] done processing
16:43:44 - cmdstanpy - INFO - Chain [1] done processing
16:43:44 - cmdstanpy - INFO - Chain [1] start processing
16:43:44 - cmdstanpy - INFO - Chain [1] done processing
16:43:45 - cmdstanpy - INFO - Chain [1] start processing
16:43:45 - cmdstanpy - INFO - Chain [1] start processing
16:43:45 - cmdstanpy - INFO - Chain [1] start processing
16:43:45 - cmdstanpy - INFO - Chain [1] start processing
16:43:45 - cmdstanpy - INFO - Chain [1] done processing
16:43:45 - cmdstanpy - INFO - Chain [1] done processing
16:43:46 - cmdstanpy - INFO - Chain [1] done processing
16:43:46 - cmdstanpy - INFO - Chain [1] done processing
16:43:46 - cmdstanpy - INFO - Chain [1] start processing
16:43:47 - cmdstanpy - INFO - Chain [1] done processing
16:43:47 - cmdstanpy - INFO - Chain [1] start processing
16:43:47 - cmdstanpy - INFO - Chain [1] start processing
16:43:48 - cmdstanpy - INFO - Chain [1] start processing
16:43:48 - cmdstanpy - INFO - Chain [1] start processing
16:43:48 - cmdstanpy - INFO - Chain [1] done processing
16:43:48 - cmdstanpy - INFO - Chain [1] done processing
16:43:48 - cmdstanpy - INFO - Chain [1] done processing
16:43:48 - cmdstanpy - INFO - Chain [1] done processing
16:43:48 - cmdstanpy - INFO - Chain [1] start processing
16:43:49 - cmdstanpy - INFO - Chain [1] done processing
16:43:50 - cmdstanpy - INFO - Chain [1] start processing
16:43:50 - cmdstanpy - INFO - Chain [1] start processing
16:43:50 - cmdstanpy - INFO - Chain [1] start processing
16:43:50 - cmdstanpy - INFO - Chain [1] start processing
16:43:50 - cmdstanpy - INFO - Chain [1] done processing
16:43:50 - cmdstanpy - INFO - Chain [1] done processing
16:43:50 - cmdstanpy - INFO - Chain [1] done processing
16:43:50 - cmdstanpy - INFO - Chain [1] done processing
16:43:50 - cmdstanpy - INFO - Chain [1] start processing
16:43:51 - cmdstanpy - INFO - Chain [1] done processing
16:43:52 - cmdstanpy - INFO - Chain [1] start processing
16:43:52 - cmdstanpy - INFO - Chain [1] start processing
16:43:52 - cmdstanpy - INFO - Chain [1] start processing
16:43:52 - cmdstanpy - INFO - Chain [1] start processing
16:43:52 - cmdstanpy - INFO - Chain [1] done processing
16:43:52 - cmdstanpy - INFO - Chain [1] done processing
16:43:52 - cmdstanpy - INFO - Chain [1] done processing
16:43:53 - cmdstanpy - INFO - Chain [1] done processing
16:43:53 - cmdstanpy - INFO - Chain [1] start processing
16:43:53 - cmdstanpy - INFO - Chain [1] done processing
16:43:54 - cmdstanpy - INFO - Chain [1] start processing
16:43:54 - cmdstanpy - INFO - Chain [1] start processing
16:43:54 - cmdstanpy - INFO - Chain [1] start processing
16:43:54 - cmdstanpy - INFO - Chain [1] start processing
16:43:54 - cmdstanpy - INFO - Chain [1] done processing
16:43:54 - cmdstanpy - INFO - Chain [1] done processing
16:43:55 - cmdstanpy - INFO - Chain [1] done processing
16:43:55 - cmdstanpy - INFO - Chain [1] done processing
16:43:55 - cmdstanpy - INFO - Chain [1] start processing
16:43:56 - cmdstanpy - INFO - Chain [1] done processing
16:43:57 - cmdstanpy - INFO - Chain [1] start processing
16:43:57 - cmdstanpy - INFO - Chain [1] start processing
16:43:57 - cmdstanpy - INFO - Chain [1] start processing
16:43:57 - cmdstanpy - INFO - Chain [1] start processing
16:43:57 - cmdstanpy - INFO - Chain [1] done processing
16:43:57 - cmdstanpy - INFO - Chain [1] done processing
16:43:57 - cmdstanpy - INFO - Chain [1] done processing
16:43:57 - cmdstanpy - INFO - Chain [1] done processing
16:43:57 - cmdstanpy - INFO - Chain [1] start processing
16:43:58 - cmdstanpy - INFO - Chain [1] done processing
16:43:59 - cmdstanpy - INFO - Chain [1] start processing
16:43:59 - cmdstanpy - INFO - Chain [1] start processing
16:43:59 - cmdstanpy - INFO - Chain [1] start processing
16:43:59 - cmdstanpy - INFO - Chain [1] start processing
16:43:59 - cmdstanpy - INFO - Chain [1] done processing
16:43:59 - cmdstanpy - INFO - Chain [1] done processing
16:43:59 - cmdstanpy - INFO - Chain [1] done processing
16:43:59 - cmdstanpy - INFO - Chain [1] done processing
16:44:00 - cmdstanpy - INFO - Chain [1] start processing
16:44:00 - cmdstanpy - INFO - Chain [1] done processing
16:44:01 - cmdstanpy - INFO - Chain [1] start processing
16:44:01 - cmdstanpy - INFO - Chain [1] start processing
16:44:01 - cmdstanpy - INFO - Chain [1] start processing
16:44:01 - cmdstanpy - INFO - Chain [1] start processing
16:44:02 - cmdstanpy - INFO - Chain [1] done processing
16:44:02 - cmdstanpy - INFO - Chain [1] done processing
16:44:02 - cmdstanpy - INFO - Chain [1] done processing
16:44:02 - cmdstanpy - INFO - Chain [1] done processing
16:44:02 - cmdstanpy - INFO - Chain [1] start processing
16:44:03 - cmdstanpy - INFO - Chain [1] done processing
16:44:03 - cmdstanpy - INFO - Chain [1] start processing
16:44:04 - cmdstanpy - INFO - Chain [1] start processing
16:44:04 - cmdstanpy - INFO - Chain [1] start processing
16:44:04 - cmdstanpy - INFO - Chain [1] start processing
16:44:04 - cmdstanpy - INFO - Chain [1] done processing
16:44:04 - cmdstanpy - INFO - Chain [1] done processing
16:44:04 - cmdstanpy - INFO - Chain [1] done processing
16:44:04 - cmdstanpy - INFO - Chain [1] done processing
16:44:04 - cmdstanpy - INFO - Chain [1] start processing
16:44:05 - cmdstanpy - INFO - Chain [1] done processing
16:44:06 - cmdstanpy - INFO - Chain [1] start processing
16:44:06 - cmdstanpy - INFO - Chain [1] start processing
16:44:06 - cmdstanpy - INFO - Chain [1] start processing
16:44:06 - cmdstanpy - INFO - Chain [1] start processing
16:44:06 - cmdstanpy - INFO - Chain [1] done processing
16:44:06 - cmdstanpy - INFO - Chain [1] done processing
16:44:06 - cmdstanpy - INFO - Chain [1] done processing
16:44:06 - cmdstanpy - INFO - Chain [1] done processing
16:44:06 - cmdstanpy - INFO - Chain [1] start processing
16:44:07 - cmdstanpy - INFO - Chain [1] done processing
16:44:08 - cmdstanpy - INFO - Chain [1] start processing
16:44:08 - cmdstanpy - INFO - Chain [1] start processing
16:44:08 - cmdstanpy - INFO - Chain [1] start processing
16:44:08 - cmdstanpy - INFO - Chain [1] start processing
16:44:08 - cmdstanpy - INFO - Chain [1] done processing
16:44:08 - cmdstanpy - INFO - Chain [1] done processing
16:44:09 - cmdstanpy - INFO - Chain [1] done processing
16:44:09 - cmdstanpy - INFO - Chain [1] done processing
16:44:09 - cmdstanpy - INFO - Chain [1] start processing
16:44:10 - cmdstanpy - INFO - Chain [1] done processing
16:44:10 - cmdstanpy - INFO - Chain [1] start processing
16:44:11 - cmdstanpy - INFO - Chain [1] start processing
16:44:11 - cmdstanpy - INFO - Chain [1] start processing
16:44:11 - cmdstanpy - INFO - Chain [1] start processing
16:44:11 - cmdstanpy - INFO - Chain [1] done processing
16:44:11 - cmdstanpy - INFO - Chain [1] done processing
16:44:11 - cmdstanpy - INFO - Chain [1] done processing
16:44:11 - cmdstanpy - INFO - Chain [1] done processing
16:44:11 - cmdstanpy - INFO - Chain [1] start processing
16:44:12 - cmdstanpy - INFO - Chain [1] done processing
16:44:13 - cmdstanpy - INFO - Chain [1] start processing
16:44:13 - cmdstanpy - INFO - Chain [1] start processing
16:44:13 - cmdstanpy - INFO - Chain [1] start processing
16:44:13 - cmdstanpy - INFO - Chain [1] start processing
16:44:13 - cmdstanpy - INFO - Chain [1] done processing
16:44:13 - cmdstanpy - INFO - Chain [1] done processing
16:44:13 - cmdstanpy - INFO - Chain [1] done processing
16:44:13 - cmdstanpy - INFO - Chain [1] done processing
16:44:13 - cmdstanpy - INFO - Chain [1] start processing
16:44:14 - cmdstanpy - INFO - Chain [1] done processing
16:44:15 - cmdstanpy - INFO - Chain [1] start processing
16:44:15 - cmdstanpy - INFO - Chain [1] start processing
16:44:15 - cmdstanpy - INFO - Chain [1] start processing
16:44:15 - cmdstanpy - INFO - Chain [1] start processing
16:44:15 - cmdstanpy - INFO - Chain [1] done processing
16:44:15 - cmdstanpy - INFO - Chain [1] done processing
16:44:16 - cmdstanpy - INFO - Chain [1] done processing
16:44:16 - cmdstanpy - INFO - Chain [1] done processing
16:44:16 - cmdstanpy - INFO - Chain [1] start processing
16:44:17 - cmdstanpy - INFO - Chain [1] done processing
16:44:17 - cmdstanpy - INFO - Chain [1] start processing
16:44:17 - cmdstanpy - INFO - Chain [1] start processing
16:44:17 - cmdstanpy - INFO - Chain [1] start processing
16:44:17 - cmdstanpy - INFO - Chain [1] start processing
16:44:18 - cmdstanpy - INFO - Chain [1] done processing
16:44:18 - cmdstanpy - INFO - Chain [1] done processing
16:44:18 - cmdstanpy - INFO - Chain [1] done processing
16:44:18 - cmdstanpy - INFO - Chain [1] done processing
16:44:18 - cmdstanpy - INFO - Chain [1] start processing
16:44:19 - cmdstanpy - INFO - Chain [1] done processing
16:44:20 - cmdstanpy - INFO - Chain [1] start processing
16:44:20 - cmdstanpy - INFO - Chain [1] start processing
16:44:20 - cmdstanpy - INFO - Chain [1] start processing
16:44:20 - cmdstanpy - INFO - Chain [1] start processing
16:44:20 - cmdstanpy - INFO - Chain [1] done processing
16:44:20 - cmdstanpy - INFO - Chain [1] done processing
16:44:20 - cmdstanpy - INFO - Chain [1] done processing
16:44:20 - cmdstanpy - INFO - Chain [1] done processing
16:44:20 - cmdstanpy - INFO - Chain [1] start processing
16:44:21 - cmdstanpy - INFO - Chain [1] done processing
16:44:22 - cmdstanpy - INFO - Chain [1] start processing
16:44:22 - cmdstanpy - INFO - Chain [1] start processing
16:44:22 - cmdstanpy - INFO - Chain [1] start processing
16:44:22 - cmdstanpy - INFO - Chain [1] start processing
16:44:22 - cmdstanpy - INFO - Chain [1] done processing
16:44:22 - cmdstanpy - INFO - Chain [1] done processing
16:44:22 - cmdstanpy - INFO - Chain [1] done processing
16:44:23 - cmdstanpy - INFO - Chain [1] done processing
16:44:23 - cmdstanpy - INFO - Chain [1] start processing
16:44:23 - cmdstanpy - INFO - Chain [1] done processing
16:44:24 - cmdstanpy - INFO - Chain [1] start processing
16:44:24 - cmdstanpy - INFO - Chain [1] start processing
16:44:24 - cmdstanpy - INFO - Chain [1] start processing
16:44:24 - cmdstanpy - INFO - Chain [1] start processing
16:44:24 - cmdstanpy - INFO - Chain [1] done processing
16:44:25 - cmdstanpy - INFO - Chain [1] done processing
16:44:25 - cmdstanpy - INFO - Chain [1] done processing
16:44:25 - cmdstanpy - INFO - Chain [1] done processing
16:44:25 - cmdstanpy - INFO - Chain [1] start processing
16:44:26 - cmdstanpy - INFO - Chain [1] done processing
16:44:27 - cmdstanpy - INFO - Chain [1] start processing
16:44:27 - cmdstanpy - INFO - Chain [1] start processing
16:44:27 - cmdstanpy - INFO - Chain [1] start processing
16:44:27 - cmdstanpy - INFO - Chain [1] start processing
16:44:27 - cmdstanpy - INFO - Chain [1] done processing
16:44:27 - cmdstanpy - INFO - Chain [1] done processing
16:44:27 - cmdstanpy - INFO - Chain [1] done processing
16:44:27 - cmdstanpy - INFO - Chain [1] done processing
16:44:27 - cmdstanpy - INFO - Chain [1] start processing
16:44:28 - cmdstanpy - INFO - Chain [1] done processing
16:44:29 - cmdstanpy - INFO - Chain [1] start processing
16:44:29 - cmdstanpy - INFO - Chain [1] start processing
16:44:29 - cmdstanpy - INFO - Chain [1] start processing
16:44:29 - cmdstanpy - INFO - Chain [1] start processing
16:44:29 - cmdstanpy - INFO - Chain [1] done processing
16:44:29 - cmdstanpy - INFO - Chain [1] done processing
16:44:29 - cmdstanpy - INFO - Chain [1] done processing
16:44:29 - cmdstanpy - INFO - Chain [1] done processing
16:44:29 - cmdstanpy - INFO - Chain [1] start processing
16:44:30 - cmdstanpy - INFO - Chain [1] done processing
16:44:31 - cmdstanpy - INFO - Chain [1] start processing
16:44:31 - cmdstanpy - INFO - Chain [1] start processing
16:44:31 - cmdstanpy - INFO - Chain [1] start processing
16:44:31 - cmdstanpy - INFO - Chain [1] start processing
16:44:31 - cmdstanpy - INFO - Chain [1] done processing
16:44:31 - cmdstanpy - INFO - Chain [1] done processing
16:44:32 - cmdstanpy - INFO - Chain [1] done processing
16:44:32 - cmdstanpy - INFO - Chain [1] done processing
16:44:32 - cmdstanpy - INFO - Chain [1] start processing
16:44:33 - cmdstanpy - INFO - Chain [1] done processing
16:44:33 - cmdstanpy - INFO - Chain [1] start processing
16:44:33 - cmdstanpy - INFO - Chain [1] start processing
16:44:33 - cmdstanpy - INFO - Chain [1] start processing
16:44:33 - cmdstanpy - INFO - Chain [1] start processing
16:44:34 - cmdstanpy - INFO - Chain [1] done processing
16:44:34 - cmdstanpy - INFO - Chain [1] done processing
16:44:34 - cmdstanpy - INFO - Chain [1] done processing
16:44:34 - cmdstanpy - INFO - Chain [1] done processing
16:44:34 - cmdstanpy - INFO - Chain [1] start processing
16:44:35 - cmdstanpy - INFO - Chain [1] done processing
16:44:36 - cmdstanpy - INFO - Chain [1] start processing
16:44:36 - cmdstanpy - INFO - Chain [1] start processing
16:44:36 - cmdstanpy - INFO - Chain [1] start processing
16:44:36 - cmdstanpy - INFO - Chain [1] start processing
16:44:36 - cmdstanpy - INFO - Chain [1] done processing
16:44:36 - cmdstanpy - INFO - Chain [1] done processing
16:44:36 - cmdstanpy - INFO - Chain [1] done processing
16:44:36 - cmdstanpy - INFO - Chain [1] done processing
16:44:36 - cmdstanpy - INFO - Chain [1] start processing
16:44:37 - cmdstanpy - INFO - Chain [1] done processing
16:44:38 - cmdstanpy - INFO - Chain [1] start processing
16:44:38 - cmdstanpy - INFO - Chain [1] start processing
16:44:38 - cmdstanpy - INFO - Chain [1] start processing
16:44:38 - cmdstanpy - INFO - Chain [1] start processing
16:44:38 - cmdstanpy - INFO - Chain [1] done processing
16:44:39 - cmdstanpy - INFO - Chain [1] done processing
16:44:39 - cmdstanpy - INFO - Chain [1] done processing
16:44:39 - cmdstanpy - INFO - Chain [1] done processing
16:44:39 - cmdstanpy - INFO - Chain [1] start processing
16:44:40 - cmdstanpy - INFO - Chain [1] done processing
16:44:40 - cmdstanpy - INFO - Chain [1] start processing
16:44:41 - cmdstanpy - INFO - Chain [1] start processing
16:44:41 - cmdstanpy - INFO - Chain [1] start processing
16:44:41 - cmdstanpy - INFO - Chain [1] start processing
16:44:41 - cmdstanpy - INFO - Chain [1] done processing
16:44:41 - cmdstanpy - INFO - Chain [1] done processing
16:44:41 - cmdstanpy - INFO - Chain [1] done processing
16:44:41 - cmdstanpy - INFO - Chain [1] done processing
16:44:41 - cmdstanpy - INFO - Chain [1] start processing
16:44:42 - cmdstanpy - INFO - Chain [1] done processing
16:44:43 - cmdstanpy - INFO - Chain [1] start processing
16:44:43 - cmdstanpy - INFO - Chain [1] start processing
16:44:43 - cmdstanpy - INFO - Chain [1] start processing
16:44:43 - cmdstanpy - INFO - Chain [1] start processing
16:44:43 - cmdstanpy - INFO - Chain [1] done processing
16:44:43 - cmdstanpy - INFO - Chain [1] done processing
16:44:43 - cmdstanpy - INFO - Chain [1] done processing
16:44:44 - cmdstanpy - INFO - Chain [1] done processing
16:44:44 - cmdstanpy - INFO - Chain [1] start processing
16:44:44 - cmdstanpy - INFO - Chain [1] done processing
16:44:45 - cmdstanpy - INFO - Chain [1] start processing
16:44:45 - cmdstanpy - INFO - Chain [1] start processing
16:44:45 - cmdstanpy - INFO - Chain [1] start processing
16:44:45 - cmdstanpy - INFO - Chain [1] start processing
16:44:45 - cmdstanpy - INFO - Chain [1] done processing
16:44:46 - cmdstanpy - INFO - Chain [1] done processing
16:44:46 - cmdstanpy - INFO - Chain [1] done processing
16:44:46 - cmdstanpy - INFO - Chain [1] done processing
16:44:46 - cmdstanpy - INFO - Chain [1] start processing
16:44:47 - cmdstanpy - INFO - Chain [1] done processing
16:44:48 - cmdstanpy - INFO - Chain [1] start processing
16:44:48 - cmdstanpy - INFO - Chain [1] start processing
16:44:48 - cmdstanpy - INFO - Chain [1] start processing
16:44:48 - cmdstanpy - INFO - Chain [1] start processing
16:44:48 - cmdstanpy - INFO - Chain [1] done processing
16:44:48 - cmdstanpy - INFO - Chain [1] done processing
16:44:48 - cmdstanpy - INFO - Chain [1] done processing
16:44:48 - cmdstanpy - INFO - Chain [1] done processing
16:44:48 - cmdstanpy - INFO - Chain [1] start processing
16:44:49 - cmdstanpy - INFO - Chain [1] done processing
16:44:50 - cmdstanpy - INFO - Chain [1] start processing
16:44:50 - cmdstanpy - INFO - Chain [1] start processing
16:44:50 - cmdstanpy - INFO - Chain [1] start processing
16:44:50 - cmdstanpy - INFO - Chain [1] start processing
16:44:50 - cmdstanpy - INFO - Chain [1] done processing
16:44:50 - cmdstanpy - INFO - Chain [1] done processing
16:44:50 - cmdstanpy - INFO - Chain [1] done processing
16:44:51 - cmdstanpy - INFO - Chain [1] done processing
16:44:51 - cmdstanpy - INFO - Chain [1] start processing
16:44:51 - cmdstanpy - INFO - Chain [1] done processing
16:44:52 - cmdstanpy - INFO - Chain [1] start processing
16:44:52 - cmdstanpy - INFO - Chain [1] start processing
16:44:52 - cmdstanpy - INFO - Chain [1] start processing
16:44:52 - cmdstanpy - INFO - Chain [1] start processing
16:44:52 - cmdstanpy - INFO - Chain [1] done processing
16:44:53 - cmdstanpy - INFO - Chain [1] done processing
16:44:53 - cmdstanpy - INFO - Chain [1] done processing
16:44:53 - cmdstanpy - INFO - Chain [1] done processing
16:44:53 - cmdstanpy - INFO - Chain [1] start processing
16:44:54 - cmdstanpy - INFO - Chain [1] done processing
16:44:55 - cmdstanpy - INFO - Chain [1] start processing
16:44:55 - cmdstanpy - INFO - Chain [1] start processing
16:44:55 - cmdstanpy - INFO - Chain [1] start processing
16:44:55 - cmdstanpy - INFO - Chain [1] start processing
16:44:55 - cmdstanpy - INFO - Chain [1] done processing
16:44:55 - cmdstanpy - INFO - Chain [1] done processing
16:44:55 - cmdstanpy - INFO - Chain [1] done processing
16:44:55 - cmdstanpy - INFO - Chain [1] done processing
16:44:55 - cmdstanpy - INFO - Chain [1] start processing
16:44:56 - cmdstanpy - INFO - Chain [1] done processing
16:44:57 - cmdstanpy - INFO - Chain [1] start processing
16:44:57 - cmdstanpy - INFO - Chain [1] start processing
16:44:57 - cmdstanpy - INFO - Chain [1] start processing
16:44:57 - cmdstanpy - INFO - Chain [1] start processing
16:44:57 - cmdstanpy - INFO - Chain [1] done processing
16:44:57 - cmdstanpy - INFO - Chain [1] done processing
16:44:57 - cmdstanpy - INFO - Chain [1] done processing
16:44:58 - cmdstanpy - INFO - Chain [1] done processing
16:44:58 - cmdstanpy - INFO - Chain [1] start processing
16:44:58 - cmdstanpy - INFO - Chain [1] done processing
16:44:59 - cmdstanpy - INFO - Chain [1] start processing
16:44:59 - cmdstanpy - INFO - Chain [1] start processing
16:44:59 - cmdstanpy - INFO - Chain [1] start processing
16:44:59 - cmdstanpy - INFO - Chain [1] start processing
16:44:59 - cmdstanpy - INFO - Chain [1] done processing
16:45:00 - cmdstanpy - INFO - Chain [1] done processing
16:45:00 - cmdstanpy - INFO - Chain [1] done processing
16:45:00 - cmdstanpy - INFO - Chain [1] done processing
16:45:00 - cmdstanpy - INFO - Chain [1] start processing
16:45:01 - cmdstanpy - INFO - Chain [1] done processing
16:45:02 - cmdstanpy - INFO - Chain [1] start processing
16:45:02 - cmdstanpy - INFO - Chain [1] start processing
16:45:02 - cmdstanpy - INFO - Chain [1] start processing
16:45:02 - cmdstanpy - INFO - Chain [1] start processing
16:45:02 - cmdstanpy - INFO - Chain [1] done processing
16:45:02 - cmdstanpy - INFO - Chain [1] done processing
16:45:02 - cmdstanpy - INFO - Chain [1] done processing
16:45:02 - cmdstanpy - INFO - Chain [1] done processing
16:45:02 - cmdstanpy - INFO - Chain [1] start processing
16:45:03 - cmdstanpy - INFO - Chain [1] done processing
16:45:04 - cmdstanpy - INFO - Chain [1] start processing
16:45:04 - cmdstanpy - INFO - Chain [1] start processing
16:45:04 - cmdstanpy - INFO - Chain [1] start processing
16:45:04 - cmdstanpy - INFO - Chain [1] start processing
16:45:04 - cmdstanpy - INFO - Chain [1] done processing
16:45:04 - cmdstanpy - INFO - Chain [1] done processing
16:45:04 - cmdstanpy - INFO - Chain [1] done processing
16:45:05 - cmdstanpy - INFO - Chain [1] done processing
16:45:05 - cmdstanpy - INFO - Chain [1] start processing
16:45:05 - cmdstanpy - INFO - Chain [1] done processing
16:45:06 - cmdstanpy - INFO - Chain [1] start processing
16:45:06 - cmdstanpy - INFO - Chain [1] start processing
16:45:06 - cmdstanpy - INFO - Chain [1] start processing
16:45:06 - cmdstanpy - INFO - Chain [1] start processing
16:45:06 - cmdstanpy - INFO - Chain [1] done processing
16:45:07 - cmdstanpy - INFO - Chain [1] done processing
16:45:07 - cmdstanpy - INFO - Chain [1] done processing
16:45:07 - cmdstanpy - INFO - Chain [1] done processing
16:45:07 - cmdstanpy - INFO - Chain [1] start processing
16:45:08 - cmdstanpy - INFO - Chain [1] done processing
16:45:09 - cmdstanpy - INFO - Chain [1] start processing
16:45:09 - cmdstanpy - INFO - Chain [1] start processing
16:45:09 - cmdstanpy - INFO - Chain [1] start processing
16:45:09 - cmdstanpy - INFO - Chain [1] start processing
16:45:09 - cmdstanpy - INFO - Chain [1] done processing
16:45:09 - cmdstanpy - INFO - Chain [1] done processing
16:45:09 - cmdstanpy - INFO - Chain [1] done processing
16:45:09 - cmdstanpy - INFO - Chain [1] done processing
16:45:09 - cmdstanpy - INFO - Chain [1] start processing

Best parameters: {'changepoint_prior_scale': 0.45, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.015}

16:45:10 - cmdstanpy - INFO - Chain [1] done processing

Test RMSE: 0.01312851228058226

16:45:11 - cmdstanpy - INFO - Chain [1] start processing
16:45:11 - cmdstanpy - INFO - Chain [1] start processing
16:45:11 - cmdstanpy - INFO - Chain [1] start processing
16:45:11 - cmdstanpy - INFO - Chain [1] start processing
16:45:11 - cmdstanpy - INFO - Chain [1] done processing
16:45:11 - cmdstanpy - INFO - Chain [1] done processing
16:45:11 - cmdstanpy - INFO - Chain [1] done processing
16:45:12 - cmdstanpy - INFO - Chain [1] done processing

Cross-Validation RMSE: 0.005042699595181557

Since I exhaustively tuned the hyperparameters that are meant to be tuned, I feel confident that these parameter values will lead to the lowest RMSE for a Prophet model trained on my data. The final parameter values I got are:

Best parameters: {'changepoint_prior_scale': 0.45, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.015, 'seasonality_mode': 'additive'}

A 'changepoint_prior_scale' of 0.45 means that the model has just under the maximum trend flexibility, whereas a 'seasonality_prior_scale' of 0.01 indicates the minimum amount of seasonality flexibility meaning that the magnitude of the parameter is shrunken with maximum regularization, and a 'holidays_prior_scale' of 0.015 means the same but for holidays flexibility. Finally, 'seasonality_mode' of 'additive' is the default which means that the seasonal effects are added as opposed to multiplied to make the final forecast and seasonal fluctuations are constant over time.

The biggest issue I had was a relatively high RMSE; however, setting growth = 'logistic' (at the suggestion of my teammate Kaylee Mo) vastly improved my results.

1.3.3.3 3. Model Performance

Below are the results of the best Prophet univariate model after tuning. Although this model’s RMSE is higher than the best ARIMA model I could make, the results make more sense in that the test RMSE is higher than the train’s. There is evidence of overfitting as the test RMSE is around 10 times as high as the train’s. However, the cross-validated RMSE is much closer than to the train RMSE.

As for the cross-validation performance across horizons, the RMSE remains fairly consistently small. This indicates stable model performance over time. The high coverages may suggest that the prediction intervals are too wide and missing values due to the lack of precision (Schmudde, 2019).

Looking at the train residual plots, one can see that they fluctuate between approximately -0.009 and 0.006 indicating that the model is not consistently solely under or overestimating the predictions. Furthermore, since the residuals oscillate around 0, there is no clear positive nor negative bias which indicates that the model does not overpredict or underpredict systematically. There are no clear trends or seasonality in the residuals, and there are two outlying points at around December 2021 and late June 2022.

Overall, the Prophet univariate model is among one of the best that I have created despite there being some evidence of lack of prediction precisions. Furthermore, although initially I thought there was a lot of evidence of overfitting, after seeing the cross-validation results, I believe the overfitting is only slight.

Code

# Initialize the Prophet model with the given parameters
model = Prophet(changepoint_prior_scale=0.45,
                seasonality_prior_scale=0.01,
                holidays_prior_scale=0.015,
                seasonality_mode='additive')

# Fit the model with the training data
model.fit(train)

# Make predictions on the training set
train_pred = model.predict(train[['ds']])

# Make predictions on the test set
test_pred = model.predict(test[['ds']])

# Calculate RMSE for training and test sets
train_rmse = sqrt(mean_squared_error(train['y'], train_pred['yhat']))
test_rmse = sqrt(mean_squared_error(test['y'], test_pred['yhat']))

# Output the RMSE values
print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")

# Plot the predictions against actuals for the training set
plt.figure(figsize=(10, 5))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train['ds'], train_pred['yhat'], label='Predicted')
plt.title('Training Data: Actual vs Predicted')
plt.legend()
plt.show()

# Plot the predictions against actuals for the test set
plt.figure(figsize=(10, 5))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test['ds'], test_pred['yhat'], label='Predicted')
plt.title('Test Data: Actual vs Predicted')
plt.legend()
plt.show()

17:10:59 - cmdstanpy - INFO - Chain [1] start processing
17:10:59 - cmdstanpy - INFO - Chain [1] done processing

Train RMSE: 0.0020465598500806034
Test RMSE: 0.02662921409495521

Code

# Perform cross-validation
df_cv = cross_validation(model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate performance metrics
df_p = performance_metrics(df_cv)

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

df_p

16:47:49 - cmdstanpy - INFO - Chain [1] start processing
16:47:49 - cmdstanpy - INFO - Chain [1] start processing
16:47:49 - cmdstanpy - INFO - Chain [1] start processing
16:47:49 - cmdstanpy - INFO - Chain [1] start processing
16:47:49 - cmdstanpy - INFO - Chain [1] done processing
16:47:49 - cmdstanpy - INFO - Chain [1] done processing
16:47:49 - cmdstanpy - INFO - Chain [1] done processing

Cross-Validation RMSE: 0.00866195901362708

16:47:49 - cmdstanpy - INFO - Chain [1] done processing

	horizon	mse	rmse	mae	mape	mdape	smape	coverage
0	3 days	0.000002	0.001330	0.001322	0.001431	0.001431	0.001432	1.0
1	5 days	0.000002	0.001525	0.001524	0.001699	0.001699	0.001699	1.0
2	6 days	0.000012	0.003434	0.003087	0.003402	0.003402	0.003395	0.5
3	9 days	0.000012	0.003405	0.003021	0.003282	0.003282	0.003275	0.5
4	10 days	0.000003	0.001831	0.001798	0.001936	0.001936	0.001936	1.0
5	12 days	0.000005	0.002190	0.002189	0.002426	0.002426	0.002426	1.0
6	13 days	0.000031	0.005583	0.004903	0.005377	0.005377	0.005358	1.0
7	16 days	0.000036	0.005970	0.005653	0.006137	0.006137	0.006116	1.0
8	17 days	0.000014	0.003778	0.003778	0.004063	0.004063	0.004063	1.0
9	19 days	0.000011	0.003337	0.003295	0.003604	0.003604	0.003605	1.0
10	20 days	0.000057	0.007532	0.006527	0.007130	0.007130	0.007097	1.0
11	23 days	0.000081	0.008975	0.008861	0.009611	0.009611	0.009564	1.0
12	24 days	0.000045	0.006737	0.006696	0.007193	0.007193	0.007186	1.0
13	26 days	0.000028	0.005260	0.005206	0.005670	0.005670	0.005673	1.0
14	27 days	0.000085	0.009231	0.008363	0.009138	0.009138	0.009088	1.0
15	30 days	0.000134	0.011555	0.011531	0.012479	0.012479	0.012401	1.0
16	31 days	0.000086	0.009254	0.009098	0.009751	0.009751	0.009731	1.0
17	33 days	0.000088	0.009399	0.009222	0.010029	0.010029	0.010082	1.0
18	34 days	0.000158	0.012557	0.012474	0.013614	0.013614	0.013597	1.0
19	37 days	0.000204	0.014283	0.014278	0.015417	0.015417	0.015298	1.0
20	38 days	0.000141	0.011882	0.011441	0.012249	0.012249	0.012204	1.0
21	40 days	0.000069	0.008316	0.008315	0.008952	0.008952	0.008993	1.0
22	41 days	0.000135	0.011598	0.011243	0.012182	0.012182	0.012148	1.0
23	44 days	0.000257	0.016038	0.015932	0.017144	0.017144	0.016997	1.0
24	45 days	0.000207	0.014377	0.013824	0.014742	0.014742	0.014676	1.0

Code

# Calculate residuals for training and test sets
train_residuals = train['y'] - train_pred['yhat']

# Plotting residuals for training set
plt.figure(figsize=(10, 5))
plt.plot(train['ds'], train_residuals, label='Training Residuals')
plt.axhline(y=0, color='r', linestyle='--')
plt.title('Training Data Residuals')
plt.xlabel('Date')
plt.ylabel('Residual')
plt.legend()
plt.show()

1.3.4 D. Prophet (Multivariate) Model

1.3.4.1 1. Data Preparation:

My data preparation is pretty similar to the univariate Prophet model. The largest differences were that I dropped the holidays column as it conflicted with the holiday aspect of the Prophet model (it inherently takes into account holidays). I added some additional lag columns and rolling statistics for extra time-series data. For these columns, I used a combination of forwards and backwards fill to impute the missing values. Finally, I scaled the data to a scale from 0 to 1 as I have for all the other models for comparison purposes and renamed the Date and response variable columns for compatibility with Prophet.

To identify the most significant predictors, I plan to initially train a model utilizing the entire set of predictors. I then will analyze the feature importance by examining the corresponding coefficients in the Prophet model. Specifically, I will select those predictors whose coefficients fall within or above the 90th percentile. This approach will be complemented by incorporating my custom-engineered features, ensuring a comprehensive and robust model.

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime
df['Date'] = pd.to_datetime(df['Date'])

# Sort by 'Date' and 'Location'
df = df.sort_values(by=['Date', 'Location'])

# Drop holidays column as it conflicts
df = df.drop(columns=['holidays'])

# Set Date as the index
df.set_index('Date', inplace=True)

# Only include numeric columns for grouping and mean calculation
numeric_cols = df.select_dtypes(include='number').columns
df_numeric = df[numeric_cols].groupby(df.index).mean()

# Merge the numeric data with the non-numeric data
df_non_numeric = df[df.columns.difference(numeric_cols)].groupby(df.index).first()
df_merged = pd.concat([df_non_numeric, df_numeric], axis=1)

# Additional time-series columns to account for 3-month pattern
pred_var = 'Additional_Doses_Vax_Pct'
df_merged['Additional_Doses_Vax_Pct_3_m_lag'] = df_merged[pred_var].shift(12)
df_merged['Additional_Doses_Vax_Pct_9_m_lag'] = df_merged[pred_var].shift(36)

# Rolling statistics
df_merged['rolling_mean'] = df_merged[pred_var].rolling(window=12).mean()
df_merged['rolling_std'] = df_merged[pred_var].rolling(window=12).std()

# Forward and backwards fill to impute missing values
df_merged.fillna(method='ffill', inplace=True)
df_merged.fillna(method='bfill', inplace=True)

# Update numeric_cols to include the new columns
numeric_cols_updated = df_merged.select_dtypes(include='number').columns

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to all relevant numeric data
scaled_data = min_max_scaler.fit_transform(df_merged[numeric_cols_updated])
df_scaled = pd.DataFrame(scaled_data, columns=numeric_cols_updated, index=df_merged.index)

# Reset index and rename columns for Prophet
df_prophet = df_scaled.reset_index().rename(columns={'Date': 'ds', pred_var: 'y'})

1.3.4.2 2. Model Building

To build my model, I started by splitting my dataset into 70% training data and 30% testing data. I then initialized and fit the prophet model on all of the regressors in my dataset. I then make predictions for the train and test set, ensuring to only pass in the ds column and other regressors and calculate the RMSEs.

There is obvious and severe overfitting in this initial model as the train RMSE is the lowest I have gotten in any model, yet the test RMSE is somehow greater than one despite my scaling the data. Upon plotting, it is revealed that this is because the model is predicting negative values.

Code

# Split into train and test sets
train_size = int(0.7 * len(df_prophet))  # 70% training data, 30% testing data
train = df_prophet[:train_size]
test = df_prophet[train_size:]

# Initialize and fit the Prophet model
model = Prophet()
for col in train.columns:
    if col not in ['ds', 'y']:
        model.add_regressor(col)

model = model.fit(train)

17:12:38 - cmdstanpy - INFO - Chain [1] start processing
17:12:47 - cmdstanpy - INFO - Chain [1] done processing

Code

# Make predictions on the training set
train_predictions = model.predict(train[['ds'] + train.columns.drop(['ds', 'y']).tolist()])
train_rmse = sqrt(mean_squared_error(train['y'], train_predictions['yhat']))

# Make predictions on the test set
test_predictions = model.predict(test[['ds'] + test.columns.drop(['ds', 'y']).tolist()])
test_rmse = sqrt(mean_squared_error(test['y'], test_predictions['yhat']))

print(f'Train RMSE: {train_rmse}')
print(f'Test RMSE: {test_rmse}')

Train RMSE: 6.511725410315001e-05
Test RMSE: 5.234941777275454

Code

# Plotting for training data
plt.figure(figsize=(12, 6))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train['ds'], train_predictions['yhat'], label='Predicted')
plt.title('Training Data: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Value')
plt.legend()
plt.show()

# Plotting for testing data
plt.figure(figsize=(12, 6))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test['ds'], test_predictions['yhat'], label='Predicted')
plt.title('Testing Data: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Value')
plt.legend()
plt.show()

To proceed, I decided to analyze the coefficients of the additional regressors to see which are important. I wanted to simplify my model by just including a few additional features so that I could reduce overfitting. I then found which features have coefficients in or above the 90th percentile of coefficients. I wanted to include the feature engineered columns I made for the rolling statistics and lags as well to increase robustness.

Code

# Extract the coefficients for additional regressors
coefficients = model.params['beta'][0]

# Map the coefficients to the corresponding regressors
regressor_names = [col for col in train.columns if col not in ['ds', 'y']]
coefficient_mapping = dict(zip(regressor_names, coefficients))

# Print the coefficients for each regressor
for regressor, coefficient in coefficient_mapping.items():
    print(f"{regressor}: {coefficient}")

MMWR_week: -17.7126
Distributed: -6.24599
Distributed_Janssen: 0.126586
Distributed_Moderna: 1.10444
Distributed_Pfizer: 1.74047
Distributed_Unk_Manuf: -0.172165
Dist_Per_100K: 5.46868
Distributed_Per_100k_5Plus: -4.95544
Distributed_Per_100k_12Plus: 15.8082
Distributed_Per_100k_18Plus: -11.192
Distributed_Per_100k_65Plus: -1.03975
Administered: -8.12095
Administered_5Plus: 4.14906
Administered_12Plus: 10.0802
Administered_18Plus: 1.31291
Administered_65Plus: -1.03781
Administered_Janssen: -0.372053
Administered_Moderna: 2.28109
Administered_Pfizer: 3.91415
Administered_Unk_Manuf: 0.134152
Admin_Per_100K: 9.96737
Admin_Per_100k_5Plus: -13.0824
Admin_Per_100k_12Plus: -0.199752
Admin_Per_100k_18Plus: 0.643769
Admin_Per_100k_65Plus: 0.440127
Recip_Administered: -13.6794
Administered_Dose1_Pop_Pct: 0.712512
Administered_Dose1_Recip_5PlusPop_Pct: 1.60661
Administered_Dose1_Recip_12PlusPop_Pct: -0.979406
Administered_Dose1_Recip_18PlusPop_Pct: 0.869499
Administered_Dose1_Recip_65PlusPop_Pct: -0.162557
Series_Complete_Pop_Pct: 2.24572
Series_Complete_5PlusPop_Pct: -1.7691
Series_Complete_12PlusPop_Pct: -2.2114
Series_Complete_18PlusPop_Pct: 0.898917
Series_Complete_65PlusPop_Pct: -0.030613
Series_Complete_Janssen: 1.1059
Series_Complete_Moderna: -0.344974
Series_Complete_Pfizer: 0.67971
Series_Complete_Unk_Manuf: -1.66363
Series_Complete_Janssen_12Plus: 2.44106
Series_Complete_Moderna_12Plus: 15.9942
Series_Complete_Pfizer_12Plus: 6.27011
Series_Complete_Unk_Manuf_12Plus: 0.632878
Series_Complete_Janssen_18Plus: -4.04329
Series_Complete_Moderna_18Plus: -14.079
Series_Complete_Pfizer_18Plus: -7.27635
Series_Complete_Unk_Manuf_18Plus: 0.363388
Series_Complete_Janssen_65Plus: 0.440104
Series_Complete_Moderna_65Plus: -0.834406
Series_Complete_Pfizer_65Plus: 0.790656
Series_Complete_Unk_Manuf_65Plus: 0.320233
Additional_Doses_18Plus_Vax_Pct: -3.33052
Additional_Doses_50Plus_Vax_Pct: 5.58217
Additional_Doses_65Plus_Vax_Pct: -0.332158
Additional_Doses_Moderna: 1.88548
Additional_Doses_Pfizer: 0.937175
Additional_Doses_Janssen: -4.39878
Additional_Doses_Unk_Manuf: 0.446367
month: 0.491734
year: 0.443981
quarter: -0.00900019
dayofyear: 7.49538
dayofmonth: 0.0439242
weekofyear: 10.1179
Additional_Doses_Vax_Pct_1_w_lag: -0.102208
Additional_Doses_Vax_Pct_3_m_lag: -0.0442407
Additional_Doses_Vax_Pct_9_m_lag: 0.0214993
rolling_mean: 0.153734
rolling_std: 0.395855

Code

# Given coefficients
coefficients = {
    "MMWR_week": -17.7126,
    "Distributed": -6.24599,
    "Distributed_Janssen": 0.126586,
    "Distributed_Moderna": 1.10444,
    "Distributed_Pfizer": 1.74047,
    "Distributed_Unk_Manuf": -0.172165,
    "Dist_Per_100K": 5.46868,
    "Distributed_Per_100k_5Plus": -4.95544,
    "Distributed_Per_100k_12Plus": 15.8082,
    "Distributed_Per_100k_18Plus": -11.192,
    "Distributed_Per_100k_65Plus": -1.03975,
    "Administered": -8.12095,
    "Administered_5Plus": 4.14906,
    "Administered_12Plus": 10.0802,
    "Administered_18Plus": 1.31291,
    "Administered_65Plus": -1.03781,
    "Administered_Janssen": -0.372053,
    "Administered_Moderna": 2.28109,
    "Administered_Pfizer": 3.91415,
    "Administered_Unk_Manuf": 0.134152,
    "Admin_Per_100K": 9.96737,
    "Admin_Per_100k_5Plus": -13.0824,
    "Admin_Per_100k_12Plus": -0.199752,
    "Admin_Per_100k_18Plus": 0.643769,
    "Admin_Per_100k_65Plus": 0.440127,
    "Recip_Administered": -13.6794,
    "Administered_Dose1_Pop_Pct": 0.712512,
    "Administered_Dose1_Recip_5PlusPop_Pct": 1.60661,
    "Administered_Dose1_Recip_12PlusPop_Pct": -0.979406,
    "Administered_Dose1_Recip_18PlusPop_Pct": 0.869499,
    "Administered_Dose1_Recip_65PlusPop_Pct": -0.162557,
    "Series_Complete_Pop_Pct": 2.24572,
    "Series_Complete_5PlusPop_Pct": -1.7691,
    "Series_Complete_12PlusPop_Pct": -2.2114,
    "Series_Complete_18PlusPop_Pct": 0.898917,
    "Series_Complete_65PlusPop_Pct": -0.030613,
    "Series_Complete_Janssen": 1.1059,
    "Series_Complete_Moderna": -0.344974,
    "Series_Complete_Pfizer": 0.67971,
    "Series_Complete_Unk_Manuf": -1.66363,
    "Series_Complete_Janssen_12Plus": 2.44106,
    "Series_Complete_Moderna_12Plus": 15.9942,
    "Series_Complete_Pfizer_12Plus": 6.27011,
    "Series_Complete_Unk_Manuf_12Plus": 0.632878,
    "Series_Complete_Janssen_18Plus": -4.04329,
    "Series_Complete_Moderna_18Plus": -14.079,
    "Series_Complete_Pfizer_18Plus": -7.27635,
    "Series_Complete_Unk_Manuf_18Plus": 0.363388,
    "Series_Complete_Janssen_65Plus": 0.440104,
    "Series_Complete_Moderna_65Plus": -0.834406,
    "Series_Complete_Pfizer_65Plus": 0.790656,
    "Series_Complete_Unk_Manuf_65Plus": 0.320233,
    "Additional_Doses_18Plus_Vax_Pct": -3.33052,
    "Additional_Doses_50Plus_Vax_Pct": 5.58217,
    "Additional_Doses_65Plus_Vax_Pct": -0.332158,
    "Additional_Doses_Moderna": 1.88548,
    "Additional_Doses_Pfizer": 0.937175,
    "Additional_Doses_Janssen": -4.39878,
    "Additional_Doses_Unk_Manuf": 0.446367,
    "month": 0.491734,
    "year": 0.443981,
    "quarter": -0.00900019,
    "dayofyear": 7.49538,
    "dayofmonth": 0.0439242,
    "weekofyear": 10.1179,
    "Additional_Doses_Vax_Pct_1_w_lag": -0.102208,
    "Additional_Doses_Vax_Pct_3_m_lag": -0.0442407,
    "Additional_Doses_Vax_Pct_9_m_lag": 0.0214993,
    "rolling_mean": 0.153734,
    "rolling_std": 0.395855
}

# Calculate absolute values of the coefficients
abs_coefficients = {key: abs(value) for key, value in coefficients.items()}

# Calculate the 90th percentile
percentile_90 = np.percentile(list(abs_coefficients.values()), 90)

print(f'90th Percentile: {percentile_90}')

# Select predictors with coefficients >= 90th percentile
selected_predictors = {key: value for key, value in abs_coefficients.items() if value >= percentile_90}

# Output the selected predictors
print(selected_predictors)

90th Percentile: 10.225310000000002
{'MMWR_week': 17.7126, 'Distributed_Per_100k_12Plus': 15.8082, 'Distributed_Per_100k_18Plus': 11.192, 'Admin_Per_100k_5Plus': 13.0824, 'Recip_Administered': 13.6794, 'Series_Complete_Moderna_12Plus': 15.9942, 'Series_Complete_Moderna_18Plus': 14.079}

Given this feature selection, I will proceed by tuning my model as I did for the univariate Prophet model. One of the largest problems I faced when creating the multivariate Prophet model was this initial high test RMSE and overfitting. I am hoping that by setting the growth as logistic will help with the model predicting negative values and that the tuning overall will help with overfitting. Furthermore, I will set a floor and cap to assert that the output value should be between 0 and 1 as another potential solution.

Code

# Set for logistic growth
train['cap'] = 1  
test['cap'] = 1 

# Initialize Prophet model with logistic growth
initial_model = Prophet(growth='logistic')

# Add country holidays
initial_model.add_country_holidays(country_name='US')

# Add specified features as additional regressors
features = [
    'MMWR_week', 'Distributed_Per_100k_12Plus', 'Distributed_Per_100k_18Plus', 
    'Admin_Per_100k_5Plus', 'Recip_Administered', 'Series_Complete_Moderna_12Plus', 
    'Series_Complete_Moderna_18Plus', "Additional_Doses_Vax_Pct_1_w_lag", 
    "Additional_Doses_Vax_Pct_3_m_lag", "Additional_Doses_Vax_Pct_9_m_lag", 
    "rolling_mean", "rolling_std"
]
for feature in features:
    initial_model.add_regressor(feature)

# Fit the model to the training data
initial_model.fit(train)

# Additional settings for logistic growth
train['floor'] = 0
test['floor'] = 0

# Parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.001, 0.01, 0.1, 0.5],
    'seasonality_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'holidays_prior_scale': [0.01, 0.1, 1.0, 10.0],
    'seasonality_mode': ['additive', 'multiplicative']
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    m = Prophet(growth='logistic', **params)
    m.add_country_holidays(country_name='US')
    # Add each additional regressor
    for feature in features:
        m.add_regressor(feature)
    m.fit(train.assign(cap=1, floor=0))

    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params1 = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params1}")

17:12:55 - cmdstanpy - INFO - Chain [1] start processing
17:12:56 - cmdstanpy - INFO - Chain [1] done processing
17:12:56 - cmdstanpy - INFO - Chain [1] start processing
17:12:56 - cmdstanpy - INFO - Chain [1] done processing
17:12:57 - cmdstanpy - INFO - Chain [1] start processing
17:12:57 - cmdstanpy - INFO - Chain [1] start processing
17:12:57 - cmdstanpy - INFO - Chain [1] start processing
17:12:57 - cmdstanpy - INFO - Chain [1] start processing
17:12:57 - cmdstanpy - INFO - Chain [1] done processing
17:12:58 - cmdstanpy - INFO - Chain [1] done processing
17:12:58 - cmdstanpy - INFO - Chain [1] done processing
17:12:59 - cmdstanpy - INFO - Chain [1] done processing
17:12:59 - cmdstanpy - INFO - Chain [1] start processing
17:12:59 - cmdstanpy - INFO - Chain [1] done processing
17:13:00 - cmdstanpy - INFO - Chain [1] start processing
17:13:00 - cmdstanpy - INFO - Chain [1] start processing
17:13:00 - cmdstanpy - INFO - Chain [1] start processing
17:13:00 - cmdstanpy - INFO - Chain [1] start processing
17:13:00 - cmdstanpy - INFO - Chain [1] done processing
17:13:01 - cmdstanpy - INFO - Chain [1] done processing
17:13:01 - cmdstanpy - INFO - Chain [1] done processing
17:13:02 - cmdstanpy - INFO - Chain [1] done processing
17:13:02 - cmdstanpy - INFO - Chain [1] start processing
17:13:02 - cmdstanpy - INFO - Chain [1] done processing
17:13:03 - cmdstanpy - INFO - Chain [1] start processing
17:13:03 - cmdstanpy - INFO - Chain [1] start processing
17:13:03 - cmdstanpy - INFO - Chain [1] start processing
17:13:03 - cmdstanpy - INFO - Chain [1] start processing
17:13:03 - cmdstanpy - INFO - Chain [1] done processing
17:13:03 - cmdstanpy - INFO - Chain [1] done processing
17:13:03 - cmdstanpy - INFO - Chain [1] done processing
17:13:04 - cmdstanpy - INFO - Chain [1] done processing
17:13:04 - cmdstanpy - INFO - Chain [1] start processing
17:13:04 - cmdstanpy - INFO - Chain [1] done processing
17:13:05 - cmdstanpy - INFO - Chain [1] start processing
17:13:05 - cmdstanpy - INFO - Chain [1] start processing
17:13:05 - cmdstanpy - INFO - Chain [1] start processing
17:13:05 - cmdstanpy - INFO - Chain [1] start processing
17:13:05 - cmdstanpy - INFO - Chain [1] done processing
17:13:05 - cmdstanpy - INFO - Chain [1] done processing
17:13:07 - cmdstanpy - INFO - Chain [1] done processing
17:13:14 - cmdstanpy - INFO - Chain [1] done processing
17:13:14 - cmdstanpy - INFO - Chain [1] start processing
17:13:14 - cmdstanpy - INFO - Chain [1] done processing
17:13:15 - cmdstanpy - INFO - Chain [1] start processing
17:13:15 - cmdstanpy - INFO - Chain [1] start processing
17:13:15 - cmdstanpy - INFO - Chain [1] start processing
17:13:15 - cmdstanpy - INFO - Chain [1] start processing
17:13:16 - cmdstanpy - INFO - Chain [1] done processing
17:13:16 - cmdstanpy - INFO - Chain [1] done processing
17:13:16 - cmdstanpy - INFO - Chain [1] done processing
17:13:19 - cmdstanpy - INFO - Chain [1] done processing
17:13:19 - cmdstanpy - INFO - Chain [1] start processing
17:13:22 - cmdstanpy - INFO - Chain [1] done processing
17:13:23 - cmdstanpy - INFO - Chain [1] start processing
17:13:23 - cmdstanpy - INFO - Chain [1] start processing
17:13:23 - cmdstanpy - INFO - Chain [1] start processing
17:13:23 - cmdstanpy - INFO - Chain [1] start processing
17:13:23 - cmdstanpy - INFO - Chain [1] done processing
17:13:26 - cmdstanpy - INFO - Chain [1] done processing
17:13:28 - cmdstanpy - INFO - Chain [1] done processing
17:13:37 - cmdstanpy - INFO - Chain [1] done processing
17:13:37 - cmdstanpy - INFO - Chain [1] start processing
17:13:38 - cmdstanpy - INFO - Chain [1] done processing
17:13:39 - cmdstanpy - INFO - Chain [1] start processing
17:13:39 - cmdstanpy - INFO - Chain [1] start processing
17:13:39 - cmdstanpy - INFO - Chain [1] start processing
17:13:39 - cmdstanpy - INFO - Chain [1] start processing
17:13:39 - cmdstanpy - INFO - Chain [1] done processing
17:13:39 - cmdstanpy - INFO - Chain [1] done processing
17:13:39 - cmdstanpy - INFO - Chain [1] done processing
17:13:40 - cmdstanpy - INFO - Chain [1] done processing
17:13:40 - cmdstanpy - INFO - Chain [1] start processing
17:13:42 - cmdstanpy - INFO - Chain [1] done processing
17:13:43 - cmdstanpy - INFO - Chain [1] start processing
17:13:43 - cmdstanpy - INFO - Chain [1] start processing
17:13:43 - cmdstanpy - INFO - Chain [1] start processing
17:13:43 - cmdstanpy - INFO - Chain [1] start processing
17:13:44 - cmdstanpy - INFO - Chain [1] done processing
17:13:44 - cmdstanpy - INFO - Chain [1] done processing
17:13:47 - cmdstanpy - INFO - Chain [1] done processing
17:13:58 - cmdstanpy - INFO - Chain [1] done processing
17:13:58 - cmdstanpy - INFO - Chain [1] start processing
17:13:59 - cmdstanpy - INFO - Chain [1] done processing
17:14:00 - cmdstanpy - INFO - Chain [1] start processing
17:14:00 - cmdstanpy - INFO - Chain [1] start processing
17:14:00 - cmdstanpy - INFO - Chain [1] start processing
17:14:00 - cmdstanpy - INFO - Chain [1] start processing
17:14:00 - cmdstanpy - INFO - Chain [1] done processing
17:14:00 - cmdstanpy - INFO - Chain [1] done processing
17:14:00 - cmdstanpy - INFO - Chain [1] done processing
17:14:01 - cmdstanpy - INFO - Chain [1] done processing
17:14:01 - cmdstanpy - INFO - Chain [1] start processing
17:14:02 - cmdstanpy - INFO - Chain [1] done processing
17:14:02 - cmdstanpy - INFO - Chain [1] start processing
17:14:02 - cmdstanpy - INFO - Chain [1] start processing
17:14:02 - cmdstanpy - INFO - Chain [1] start processing
17:14:03 - cmdstanpy - INFO - Chain [1] start processing
17:14:03 - cmdstanpy - INFO - Chain [1] done processing
17:14:03 - cmdstanpy - INFO - Chain [1] done processing
17:14:03 - cmdstanpy - INFO - Chain [1] done processing
17:14:04 - cmdstanpy - INFO - Chain [1] done processing
17:14:04 - cmdstanpy - INFO - Chain [1] start processing
17:14:04 - cmdstanpy - INFO - Chain [1] done processing
17:14:05 - cmdstanpy - INFO - Chain [1] start processing
17:14:05 - cmdstanpy - INFO - Chain [1] start processing
17:14:05 - cmdstanpy - INFO - Chain [1] start processing
17:14:05 - cmdstanpy - INFO - Chain [1] start processing
17:14:05 - cmdstanpy - INFO - Chain [1] done processing
17:14:05 - cmdstanpy - INFO - Chain [1] done processing
17:14:05 - cmdstanpy - INFO - Chain [1] done processing
17:14:06 - cmdstanpy - INFO - Chain [1] done processing
17:14:06 - cmdstanpy - INFO - Chain [1] start processing
17:14:06 - cmdstanpy - INFO - Chain [1] done processing
17:14:07 - cmdstanpy - INFO - Chain [1] start processing
17:14:07 - cmdstanpy - INFO - Chain [1] start processing
17:14:07 - cmdstanpy - INFO - Chain [1] start processing
17:14:07 - cmdstanpy - INFO - Chain [1] start processing
17:14:07 - cmdstanpy - INFO - Chain [1] done processing
17:14:07 - cmdstanpy - INFO - Chain [1] done processing
17:14:09 - cmdstanpy - INFO - Chain [1] done processing
17:14:16 - cmdstanpy - INFO - Chain [1] done processing
17:14:16 - cmdstanpy - INFO - Chain [1] start processing
17:14:17 - cmdstanpy - INFO - Chain [1] done processing
17:14:18 - cmdstanpy - INFO - Chain [1] start processing
17:14:18 - cmdstanpy - INFO - Chain [1] start processing
17:14:18 - cmdstanpy - INFO - Chain [1] start processing
17:14:18 - cmdstanpy - INFO - Chain [1] start processing
17:14:18 - cmdstanpy - INFO - Chain [1] done processing
17:14:18 - cmdstanpy - INFO - Chain [1] done processing
17:14:18 - cmdstanpy - INFO - Chain [1] done processing
17:14:21 - cmdstanpy - INFO - Chain [1] done processing
17:14:21 - cmdstanpy - INFO - Chain [1] start processing
17:14:24 - cmdstanpy - INFO - Chain [1] done processing
17:14:25 - cmdstanpy - INFO - Chain [1] start processing
17:14:25 - cmdstanpy - INFO - Chain [1] start processing
17:14:25 - cmdstanpy - INFO - Chain [1] start processing
17:14:25 - cmdstanpy - INFO - Chain [1] start processing
17:14:26 - cmdstanpy - INFO - Chain [1] done processing
17:14:28 - cmdstanpy - INFO - Chain [1] done processing
17:14:30 - cmdstanpy - INFO - Chain [1] done processing
17:14:40 - cmdstanpy - INFO - Chain [1] done processing
17:14:40 - cmdstanpy - INFO - Chain [1] start processing
17:14:40 - cmdstanpy - INFO - Chain [1] done processing
17:14:41 - cmdstanpy - INFO - Chain [1] start processing
17:14:41 - cmdstanpy - INFO - Chain [1] start processing
17:14:41 - cmdstanpy - INFO - Chain [1] start processing
17:14:41 - cmdstanpy - INFO - Chain [1] start processing
17:14:41 - cmdstanpy - INFO - Chain [1] done processing
17:14:42 - cmdstanpy - INFO - Chain [1] done processing
17:14:42 - cmdstanpy - INFO - Chain [1] done processing
17:14:42 - cmdstanpy - INFO - Chain [1] done processing
17:14:42 - cmdstanpy - INFO - Chain [1] start processing
17:14:44 - cmdstanpy - INFO - Chain [1] done processing
17:14:45 - cmdstanpy - INFO - Chain [1] start processing
17:14:45 - cmdstanpy - INFO - Chain [1] start processing
17:14:45 - cmdstanpy - INFO - Chain [1] start processing
17:14:45 - cmdstanpy - INFO - Chain [1] start processing
17:14:46 - cmdstanpy - INFO - Chain [1] done processing
17:14:46 - cmdstanpy - INFO - Chain [1] done processing
17:14:49 - cmdstanpy - INFO - Chain [1] done processing
17:15:01 - cmdstanpy - INFO - Chain [1] done processing
17:15:01 - cmdstanpy - INFO - Chain [1] start processing
17:15:01 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] start processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:02 - cmdstanpy - INFO - Chain [1] done processing
17:15:03 - cmdstanpy - INFO - Chain [1] done processing
17:15:03 - cmdstanpy - INFO - Chain [1] start processing
17:15:04 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] start processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:05 - cmdstanpy - INFO - Chain [1] done processing
17:15:06 - cmdstanpy - INFO - Chain [1] done processing
17:15:06 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] done processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:07 - cmdstanpy - INFO - Chain [1] start processing
17:15:08 - cmdstanpy - INFO - Chain [1] start processing
17:15:08 - cmdstanpy - INFO - Chain [1] start processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:08 - cmdstanpy - INFO - Chain [1] start processing
17:15:08 - cmdstanpy - INFO - Chain [1] done processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] start processing
17:15:09 - cmdstanpy - INFO - Chain [1] done processing
17:15:10 - cmdstanpy - INFO - Chain [1] done processing
17:15:11 - cmdstanpy - INFO - Chain [1] done processing
17:15:19 - cmdstanpy - INFO - Chain [1] done processing
17:15:19 - cmdstanpy - INFO - Chain [1] start processing
17:15:19 - cmdstanpy - INFO - Chain [1] done processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] start processing
17:15:20 - cmdstanpy - INFO - Chain [1] done processing
17:15:20 - cmdstanpy - INFO - Chain [1] done processing
17:15:21 - cmdstanpy - INFO - Chain [1] done processing
17:15:23 - cmdstanpy - INFO - Chain [1] done processing
17:15:24 - cmdstanpy - INFO - Chain [1] start processing
17:15:27 - cmdstanpy - INFO - Chain [1] done processing
17:15:28 - cmdstanpy - INFO - Chain [1] start processing
17:15:28 - cmdstanpy - INFO - Chain [1] start processing
17:15:28 - cmdstanpy - INFO - Chain [1] start processing
17:15:28 - cmdstanpy - INFO - Chain [1] start processing
17:15:28 - cmdstanpy - INFO - Chain [1] done processing
17:15:30 - cmdstanpy - INFO - Chain [1] done processing
17:15:32 - cmdstanpy - INFO - Chain [1] done processing
17:15:42 - cmdstanpy - INFO - Chain [1] done processing
17:15:42 - cmdstanpy - INFO - Chain [1] start processing
17:15:43 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:44 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] done processing
17:15:44 - cmdstanpy - INFO - Chain [1] start processing
17:15:47 - cmdstanpy - INFO - Chain [1] done processing
17:15:47 - cmdstanpy - INFO - Chain [1] start processing
17:15:48 - cmdstanpy - INFO - Chain [1] start processing
17:15:48 - cmdstanpy - INFO - Chain [1] start processing
17:15:48 - cmdstanpy - INFO - Chain [1] start processing
17:15:49 - cmdstanpy - INFO - Chain [1] done processing
17:15:49 - cmdstanpy - INFO - Chain [1] done processing
17:15:52 - cmdstanpy - INFO - Chain [1] done processing
17:16:03 - cmdstanpy - INFO - Chain [1] done processing
17:16:03 - cmdstanpy - INFO - Chain [1] start processing
17:16:03 - cmdstanpy - INFO - Chain [1] done processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] start processing
17:16:04 - cmdstanpy - INFO - Chain [1] done processing
17:16:04 - cmdstanpy - INFO - Chain [1] done processing
17:16:05 - cmdstanpy - INFO - Chain [1] done processing
17:16:06 - cmdstanpy - INFO - Chain [1] done processing
17:16:06 - cmdstanpy - INFO - Chain [1] start processing
17:16:06 - cmdstanpy - INFO - Chain [1] done processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] start processing
17:16:07 - cmdstanpy - INFO - Chain [1] done processing
17:16:07 - cmdstanpy - INFO - Chain [1] done processing
17:16:08 - cmdstanpy - INFO - Chain [1] done processing
17:16:09 - cmdstanpy - INFO - Chain [1] done processing
17:16:09 - cmdstanpy - INFO - Chain [1] start processing
17:16:09 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] done processing
17:16:10 - cmdstanpy - INFO - Chain [1] start processing
17:16:11 - cmdstanpy - INFO - Chain [1] done processing
17:16:12 - cmdstanpy - INFO - Chain [1] start processing
17:16:12 - cmdstanpy - INFO - Chain [1] start processing
17:16:12 - cmdstanpy - INFO - Chain [1] start processing
17:16:12 - cmdstanpy - INFO - Chain [1] start processing
17:16:12 - cmdstanpy - INFO - Chain [1] done processing
17:16:12 - cmdstanpy - INFO - Chain [1] done processing
17:16:14 - cmdstanpy - INFO - Chain [1] done processing
17:16:21 - cmdstanpy - INFO - Chain [1] done processing
17:16:21 - cmdstanpy - INFO - Chain [1] start processing
17:16:21 - cmdstanpy - INFO - Chain [1] done processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] start processing
17:16:22 - cmdstanpy - INFO - Chain [1] done processing
17:16:22 - cmdstanpy - INFO - Chain [1] done processing
17:16:23 - cmdstanpy - INFO - Chain [1] done processing
17:16:25 - cmdstanpy - INFO - Chain [1] done processing
17:16:26 - cmdstanpy - INFO - Chain [1] start processing
17:16:29 - cmdstanpy - INFO - Chain [1] done processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] start processing
17:16:30 - cmdstanpy - INFO - Chain [1] done processing
17:16:32 - cmdstanpy - INFO - Chain [1] done processing
17:16:34 - cmdstanpy - INFO - Chain [1] done processing
17:16:44 - cmdstanpy - INFO - Chain [1] done processing
17:16:44 - cmdstanpy - INFO - Chain [1] start processing
17:16:45 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] done processing
17:16:46 - cmdstanpy - INFO - Chain [1] start processing
17:16:49 - cmdstanpy - INFO - Chain [1] done processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:50 - cmdstanpy - INFO - Chain [1] start processing
17:16:51 - cmdstanpy - INFO - Chain [1] done processing
17:16:51 - cmdstanpy - INFO - Chain [1] done processing
17:16:54 - cmdstanpy - INFO - Chain [1] done processing
17:17:05 - cmdstanpy - INFO - Chain [1] done processing
17:17:05 - cmdstanpy - INFO - Chain [1] start processing
17:17:05 - cmdstanpy - INFO - Chain [1] done processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] start processing
17:17:06 - cmdstanpy - INFO - Chain [1] done processing
17:17:06 - cmdstanpy - INFO - Chain [1] done processing
17:17:06 - cmdstanpy - INFO - Chain [1] done processing
17:17:07 - cmdstanpy - INFO - Chain [1] done processing
17:17:07 - cmdstanpy - INFO - Chain [1] start processing
17:17:07 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] done processing
17:17:08 - cmdstanpy - INFO - Chain [1] start processing
17:17:09 - cmdstanpy - INFO - Chain [1] done processing
17:17:10 - cmdstanpy - INFO - Chain [1] start processing
17:17:10 - cmdstanpy - INFO - Chain [1] start processing
17:17:10 - cmdstanpy - INFO - Chain [1] start processing
17:17:10 - cmdstanpy - INFO - Chain [1] start processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:10 - cmdstanpy - INFO - Chain [1] done processing
17:17:11 - cmdstanpy - INFO - Chain [1] done processing
17:17:11 - cmdstanpy - INFO - Chain [1] start processing
17:17:11 - cmdstanpy - INFO - Chain [1] done processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] start processing
17:17:12 - cmdstanpy - INFO - Chain [1] done processing
17:17:12 - cmdstanpy - INFO - Chain [1] done processing
17:17:13 - cmdstanpy - INFO - Chain [1] done processing
17:17:13 - cmdstanpy - INFO - Chain [1] done processing
17:17:13 - cmdstanpy - INFO - Chain [1] start processing
17:17:13 - cmdstanpy - INFO - Chain [1] done processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] done processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:14 - cmdstanpy - INFO - Chain [1] start processing
17:17:15 - cmdstanpy - INFO - Chain [1] done processing
17:17:15 - cmdstanpy - INFO - Chain [1] done processing
17:17:22 - cmdstanpy - INFO - Chain [1] done processing
17:17:22 - cmdstanpy - INFO - Chain [1] start processing
17:17:23 - cmdstanpy - INFO - Chain [1] done processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] start processing
17:17:24 - cmdstanpy - INFO - Chain [1] done processing
17:17:24 - cmdstanpy - INFO - Chain [1] done processing
17:17:25 - cmdstanpy - INFO - Chain [1] done processing
17:17:26 - cmdstanpy - INFO - Chain [1] done processing
17:17:26 - cmdstanpy - INFO - Chain [1] start processing
17:17:26 - cmdstanpy - INFO - Chain [1] done processing
17:17:27 - cmdstanpy - INFO - Chain [1] start processing
17:17:27 - cmdstanpy - INFO - Chain [1] start processing
17:17:27 - cmdstanpy - INFO - Chain [1] done processing
17:17:27 - cmdstanpy - INFO - Chain [1] start processing
17:17:27 - cmdstanpy - INFO - Chain [1] start processing
17:17:27 - cmdstanpy - INFO - Chain [1] done processing
17:17:27 - cmdstanpy - INFO - Chain [1] done processing
17:17:28 - cmdstanpy - INFO - Chain [1] done processing
17:17:28 - cmdstanpy - INFO - Chain [1] start processing
17:17:29 - cmdstanpy - INFO - Chain [1] done processing
17:17:29 - cmdstanpy - INFO - Chain [1] start processing
17:17:29 - cmdstanpy - INFO - Chain [1] start processing
17:17:30 - cmdstanpy - INFO - Chain [1] start processing
17:17:30 - cmdstanpy - INFO - Chain [1] start processing
17:17:30 - cmdstanpy - INFO - Chain [1] done processing
17:17:30 - cmdstanpy - INFO - Chain [1] done processing
17:17:31 - cmdstanpy - INFO - Chain [1] done processing
17:17:31 - cmdstanpy - INFO - Chain [1] done processing
17:17:31 - cmdstanpy - INFO - Chain [1] start processing
17:17:31 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:32 - cmdstanpy - INFO - Chain [1] start processing
17:17:32 - cmdstanpy - INFO - Chain [1] done processing
17:17:33 - cmdstanpy - INFO - Chain [1] start processing
17:17:33 - cmdstanpy - INFO - Chain [1] start processing
17:17:33 - cmdstanpy - INFO - Chain [1] done processing
17:17:33 - cmdstanpy - INFO - Chain [1] start processing
17:17:33 - cmdstanpy - INFO - Chain [1] start processing
17:17:34 - cmdstanpy - INFO - Chain [1] done processing
17:17:34 - cmdstanpy - INFO - Chain [1] done processing
17:17:34 - cmdstanpy - INFO - Chain [1] done processing
17:17:34 - cmdstanpy - INFO - Chain [1] start processing
17:17:35 - cmdstanpy - INFO - Chain [1] done processing
17:17:36 - cmdstanpy - INFO - Chain [1] start processing
17:17:36 - cmdstanpy - INFO - Chain [1] start processing
17:17:36 - cmdstanpy - INFO - Chain [1] start processing
17:17:36 - cmdstanpy - INFO - Chain [1] start processing
17:17:36 - cmdstanpy - INFO - Chain [1] done processing
17:17:36 - cmdstanpy - INFO - Chain [1] done processing
17:17:36 - cmdstanpy - INFO - Chain [1] done processing
17:17:37 - cmdstanpy - INFO - Chain [1] done processing
17:17:37 - cmdstanpy - INFO - Chain [1] start processing
17:17:37 - cmdstanpy - INFO - Chain [1] done processing
17:17:38 - cmdstanpy - INFO - Chain [1] start processing
17:17:38 - cmdstanpy - INFO - Chain [1] start processing
17:17:38 - cmdstanpy - INFO - Chain [1] start processing
17:17:38 - cmdstanpy - INFO - Chain [1] start processing
17:17:38 - cmdstanpy - INFO - Chain [1] done processing
17:17:38 - cmdstanpy - INFO - Chain [1] done processing
17:17:38 - cmdstanpy - INFO - Chain [1] done processing
17:17:39 - cmdstanpy - INFO - Chain [1] done processing
17:17:39 - cmdstanpy - INFO - Chain [1] start processing
17:17:39 - cmdstanpy - INFO - Chain [1] done processing
17:17:40 - cmdstanpy - INFO - Chain [1] start processing
17:17:40 - cmdstanpy - INFO - Chain [1] start processing
17:17:40 - cmdstanpy - INFO - Chain [1] done processing
17:17:40 - cmdstanpy - INFO - Chain [1] start processing
17:17:40 - cmdstanpy - INFO - Chain [1] start processing
17:17:40 - cmdstanpy - INFO - Chain [1] done processing
17:17:40 - cmdstanpy - INFO - Chain [1] done processing
17:17:48 - cmdstanpy - INFO - Chain [1] done processing
17:17:48 - cmdstanpy - INFO - Chain [1] start processing
17:17:49 - cmdstanpy - INFO - Chain [1] done processing
17:17:49 - cmdstanpy - INFO - Chain [1] start processing
17:17:49 - cmdstanpy - INFO - Chain [1] start processing
17:17:49 - cmdstanpy - INFO - Chain [1] start processing
17:17:49 - cmdstanpy - INFO - Chain [1] start processing
17:17:50 - cmdstanpy - INFO - Chain [1] done processing
17:17:50 - cmdstanpy - INFO - Chain [1] done processing
17:17:50 - cmdstanpy - INFO - Chain [1] done processing
17:17:51 - cmdstanpy - INFO - Chain [1] done processing
17:17:51 - cmdstanpy - INFO - Chain [1] start processing
17:17:52 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] start processing
17:17:53 - cmdstanpy - INFO - Chain [1] start processing
17:17:53 - cmdstanpy - INFO - Chain [1] start processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] start processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] done processing
17:17:53 - cmdstanpy - INFO - Chain [1] start processing
17:17:54 - cmdstanpy - INFO - Chain [1] done processing
17:17:55 - cmdstanpy - INFO - Chain [1] start processing
17:17:55 - cmdstanpy - INFO - Chain [1] start processing
17:17:55 - cmdstanpy - INFO - Chain [1] start processing
17:17:55 - cmdstanpy - INFO - Chain [1] start processing
17:17:55 - cmdstanpy - INFO - Chain [1] done processing
17:17:56 - cmdstanpy - INFO - Chain [1] done processing
17:17:56 - cmdstanpy - INFO - Chain [1] done processing
17:17:56 - cmdstanpy - INFO - Chain [1] done processing
17:17:56 - cmdstanpy - INFO - Chain [1] start processing
17:17:57 - cmdstanpy - INFO - Chain [1] done processing
17:17:57 - cmdstanpy - INFO - Chain [1] start processing
17:17:57 - cmdstanpy - INFO - Chain [1] start processing
17:17:57 - cmdstanpy - INFO - Chain [1] start processing
17:17:57 - cmdstanpy - INFO - Chain [1] start processing
17:17:58 - cmdstanpy - INFO - Chain [1] done processing
17:17:58 - cmdstanpy - INFO - Chain [1] done processing
17:17:58 - cmdstanpy - INFO - Chain [1] done processing
17:17:58 - cmdstanpy - INFO - Chain [1] done processing
17:17:58 - cmdstanpy - INFO - Chain [1] start processing
17:17:58 - cmdstanpy - INFO - Chain [1] done processing
17:17:59 - cmdstanpy - INFO - Chain [1] start processing
17:17:59 - cmdstanpy - INFO - Chain [1] done processing
17:17:59 - cmdstanpy - INFO - Chain [1] start processing
17:17:59 - cmdstanpy - INFO - Chain [1] start processing
17:17:59 - cmdstanpy - INFO - Chain [1] start processing
17:17:59 - cmdstanpy - INFO - Chain [1] done processing
17:17:59 - cmdstanpy - INFO - Chain [1] done processing
17:17:59 - cmdstanpy - INFO - Chain [1] done processing
17:17:59 - cmdstanpy - INFO - Chain [1] start processing
17:18:00 - cmdstanpy - INFO - Chain [1] done processing
17:18:01 - cmdstanpy - INFO - Chain [1] start processing
17:18:01 - cmdstanpy - INFO - Chain [1] start processing
17:18:01 - cmdstanpy - INFO - Chain [1] start processing
17:18:01 - cmdstanpy - INFO - Chain [1] done processing
17:18:01 - cmdstanpy - INFO - Chain [1] start processing
17:18:01 - cmdstanpy - INFO - Chain [1] done processing
17:18:02 - cmdstanpy - INFO - Chain [1] done processing
17:18:02 - cmdstanpy - INFO - Chain [1] done processing
17:18:02 - cmdstanpy - INFO - Chain [1] start processing
17:18:02 - cmdstanpy - INFO - Chain [1] done processing
17:18:03 - cmdstanpy - INFO - Chain [1] start processing
17:18:03 - cmdstanpy - INFO - Chain [1] start processing
17:18:03 - cmdstanpy - INFO - Chain [1] start processing
17:18:03 - cmdstanpy - INFO - Chain [1] start processing
17:18:03 - cmdstanpy - INFO - Chain [1] done processing
17:18:04 - cmdstanpy - INFO - Chain [1] done processing
17:18:04 - cmdstanpy - INFO - Chain [1] done processing
17:18:04 - cmdstanpy - INFO - Chain [1] done processing
17:18:04 - cmdstanpy - INFO - Chain [1] start processing
17:18:04 - cmdstanpy - INFO - Chain [1] done processing
17:18:05 - cmdstanpy - INFO - Chain [1] start processing
17:18:05 - cmdstanpy - INFO - Chain [1] start processing
17:18:05 - cmdstanpy - INFO - Chain [1] done processing
17:18:05 - cmdstanpy - INFO - Chain [1] start processing
17:18:05 - cmdstanpy - INFO - Chain [1] start processing
17:18:06 - cmdstanpy - INFO - Chain [1] done processing
17:18:06 - cmdstanpy - INFO - Chain [1] done processing
17:18:13 - cmdstanpy - INFO - Chain [1] done processing
17:18:14 - cmdstanpy - INFO - Chain [1] start processing
17:18:14 - cmdstanpy - INFO - Chain [1] done processing
17:18:15 - cmdstanpy - INFO - Chain [1] start processing
17:18:15 - cmdstanpy - INFO - Chain [1] start processing
17:18:15 - cmdstanpy - INFO - Chain [1] start processing
17:18:15 - cmdstanpy - INFO - Chain [1] start processing
17:18:15 - cmdstanpy - INFO - Chain [1] done processing
17:18:15 - cmdstanpy - INFO - Chain [1] done processing
17:18:16 - cmdstanpy - INFO - Chain [1] done processing
17:18:17 - cmdstanpy - INFO - Chain [1] done processing
17:18:17 - cmdstanpy - INFO - Chain [1] start processing
17:18:17 - cmdstanpy - INFO - Chain [1] done processing
17:18:18 - cmdstanpy - INFO - Chain [1] start processing
17:18:18 - cmdstanpy - INFO - Chain [1] start processing
17:18:18 - cmdstanpy - INFO - Chain [1] start processing
17:18:18 - cmdstanpy - INFO - Chain [1] start processing
17:18:18 - cmdstanpy - INFO - Chain [1] done processing
17:18:18 - cmdstanpy - INFO - Chain [1] done processing
17:18:19 - cmdstanpy - INFO - Chain [1] done processing
17:18:19 - cmdstanpy - INFO - Chain [1] done processing
17:18:19 - cmdstanpy - INFO - Chain [1] start processing
17:18:20 - cmdstanpy - INFO - Chain [1] done processing
17:18:20 - cmdstanpy - INFO - Chain [1] start processing
17:18:20 - cmdstanpy - INFO - Chain [1] start processing
17:18:20 - cmdstanpy - INFO - Chain [1] start processing
17:18:20 - cmdstanpy - INFO - Chain [1] start processing
17:18:21 - cmdstanpy - INFO - Chain [1] done processing
17:18:21 - cmdstanpy - INFO - Chain [1] done processing
17:18:22 - cmdstanpy - INFO - Chain [1] done processing
17:18:22 - cmdstanpy - INFO - Chain [1] done processing
17:18:22 - cmdstanpy - INFO - Chain [1] start processing
17:18:22 - cmdstanpy - INFO - Chain [1] done processing
17:18:23 - cmdstanpy - INFO - Chain [1] start processing
17:18:23 - cmdstanpy - INFO - Chain [1] start processing
17:18:23 - cmdstanpy - INFO - Chain [1] start processing
17:18:23 - cmdstanpy - INFO - Chain [1] start processing
17:18:23 - cmdstanpy - INFO - Chain [1] done processing
17:18:23 - cmdstanpy - INFO - Chain [1] done processing
17:18:23 - cmdstanpy - INFO - Chain [1] done processing
17:18:23 - cmdstanpy - INFO - Chain [1] done processing
17:18:23 - cmdstanpy - INFO - Chain [1] start processing
17:18:23 - cmdstanpy - INFO - Chain [1] done processing
17:18:24 - cmdstanpy - INFO - Chain [1] start processing
17:18:24 - cmdstanpy - INFO - Chain [1] start processing
17:18:24 - cmdstanpy - INFO - Chain [1] done processing
17:18:24 - cmdstanpy - INFO - Chain [1] start processing
17:18:24 - cmdstanpy - INFO - Chain [1] start processing
17:18:24 - cmdstanpy - INFO - Chain [1] done processing
17:18:25 - cmdstanpy - INFO - Chain [1] done processing
17:18:25 - cmdstanpy - INFO - Chain [1] done processing
17:18:25 - cmdstanpy - INFO - Chain [1] start processing
17:18:26 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] start processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:27 - cmdstanpy - INFO - Chain [1] done processing
17:18:28 - cmdstanpy - INFO - Chain [1] done processing
17:18:28 - cmdstanpy - INFO - Chain [1] start processing
17:18:28 - cmdstanpy - INFO - Chain [1] done processing
17:18:29 - cmdstanpy - INFO - Chain [1] start processing
17:18:29 - cmdstanpy - INFO - Chain [1] start processing
17:18:29 - cmdstanpy - INFO - Chain [1] start processing
17:18:29 - cmdstanpy - INFO - Chain [1] start processing
17:18:29 - cmdstanpy - INFO - Chain [1] done processing
17:18:29 - cmdstanpy - INFO - Chain [1] done processing
17:18:29 - cmdstanpy - INFO - Chain [1] done processing
17:18:30 - cmdstanpy - INFO - Chain [1] done processing
17:18:30 - cmdstanpy - INFO - Chain [1] start processing
17:18:30 - cmdstanpy - INFO - Chain [1] done processing
17:18:31 - cmdstanpy - INFO - Chain [1] start processing
17:18:31 - cmdstanpy - INFO - Chain [1] start processing
17:18:31 - cmdstanpy - INFO - Chain [1] done processing
17:18:31 - cmdstanpy - INFO - Chain [1] start processing
17:18:31 - cmdstanpy - INFO - Chain [1] start processing
17:18:31 - cmdstanpy - INFO - Chain [1] done processing
17:18:31 - cmdstanpy - INFO - Chain [1] done processing
17:18:39 - cmdstanpy - INFO - Chain [1] done processing
17:18:39 - cmdstanpy - INFO - Chain [1] start processing
17:18:40 - cmdstanpy - INFO - Chain [1] done processing
17:18:41 - cmdstanpy - INFO - Chain [1] start processing
17:18:41 - cmdstanpy - INFO - Chain [1] start processing
17:18:41 - cmdstanpy - INFO - Chain [1] start processing
17:18:41 - cmdstanpy - INFO - Chain [1] start processing
17:18:41 - cmdstanpy - INFO - Chain [1] done processing
17:18:41 - cmdstanpy - INFO - Chain [1] done processing
17:18:42 - cmdstanpy - INFO - Chain [1] done processing
17:18:42 - cmdstanpy - INFO - Chain [1] done processing
17:18:43 - cmdstanpy - INFO - Chain [1] start processing
17:18:43 - cmdstanpy - INFO - Chain [1] done processing
17:18:44 - cmdstanpy - INFO - Chain [1] start processing
17:18:44 - cmdstanpy - INFO - Chain [1] start processing
17:18:44 - cmdstanpy - INFO - Chain [1] done processing
17:18:44 - cmdstanpy - INFO - Chain [1] start processing
17:18:44 - cmdstanpy - INFO - Chain [1] start processing
17:18:44 - cmdstanpy - INFO - Chain [1] done processing
17:18:44 - cmdstanpy - INFO - Chain [1] done processing
17:18:45 - cmdstanpy - INFO - Chain [1] done processing
17:18:45 - cmdstanpy - INFO - Chain [1] start processing
17:18:45 - cmdstanpy - INFO - Chain [1] done processing
17:18:46 - cmdstanpy - INFO - Chain [1] start processing
17:18:46 - cmdstanpy - INFO - Chain [1] start processing
17:18:46 - cmdstanpy - INFO - Chain [1] start processing
17:18:46 - cmdstanpy - INFO - Chain [1] start processing
17:18:46 - cmdstanpy - INFO - Chain [1] done processing
17:18:47 - cmdstanpy - INFO - Chain [1] done processing
17:18:47 - cmdstanpy - INFO - Chain [1] done processing
17:18:48 - cmdstanpy - INFO - Chain [1] done processing
17:18:48 - cmdstanpy - INFO - Chain [1] start processing
17:18:48 - cmdstanpy - INFO - Chain [1] done processing
17:18:49 - cmdstanpy - INFO - Chain [1] start processing
17:18:49 - cmdstanpy - INFO - Chain [1] start processing
17:18:49 - cmdstanpy - INFO - Chain [1] start processing
17:18:49 - cmdstanpy - INFO - Chain [1] start processing
17:18:49 - cmdstanpy - INFO - Chain [1] done processing
17:18:49 - cmdstanpy - INFO - Chain [1] done processing
17:18:49 - cmdstanpy - INFO - Chain [1] done processing
17:18:49 - cmdstanpy - INFO - Chain [1] done processing
17:18:49 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] done processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:50 - cmdstanpy - INFO - Chain [1] start processing
17:18:51 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] done processing
17:18:51 - cmdstanpy - INFO - Chain [1] start processing
17:18:52 - cmdstanpy - INFO - Chain [1] done processing
17:18:53 - cmdstanpy - INFO - Chain [1] start processing
17:18:53 - cmdstanpy - INFO - Chain [1] start processing
17:18:53 - cmdstanpy - INFO - Chain [1] start processing
17:18:53 - cmdstanpy - INFO - Chain [1] start processing
17:18:53 - cmdstanpy - INFO - Chain [1] done processing
17:18:53 - cmdstanpy - INFO - Chain [1] done processing
17:18:53 - cmdstanpy - INFO - Chain [1] done processing
17:18:53 - cmdstanpy - INFO - Chain [1] done processing
17:18:54 - cmdstanpy - INFO - Chain [1] start processing
17:18:54 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] start processing
17:18:55 - cmdstanpy - INFO - Chain [1] start processing
17:18:55 - cmdstanpy - INFO - Chain [1] start processing
17:18:55 - cmdstanpy - INFO - Chain [1] start processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] done processing
17:18:55 - cmdstanpy - INFO - Chain [1] start processing
17:18:56 - cmdstanpy - INFO - Chain [1] done processing
17:18:57 - cmdstanpy - INFO - Chain [1] start processing
17:18:57 - cmdstanpy - INFO - Chain [1] start processing
17:18:57 - cmdstanpy - INFO - Chain [1] start processing
17:18:57 - cmdstanpy - INFO - Chain [1] start processing
17:18:57 - cmdstanpy - INFO - Chain [1] done processing
17:18:57 - cmdstanpy - INFO - Chain [1] done processing
17:18:57 - cmdstanpy - INFO - Chain [1] done processing
17:18:59 - cmdstanpy - INFO - Chain [1] done processing
17:18:59 - cmdstanpy - INFO - Chain [1] start processing
17:18:59 - cmdstanpy - INFO - Chain [1] done processing
17:19:00 - cmdstanpy - INFO - Chain [1] start processing
17:19:00 - cmdstanpy - INFO - Chain [1] start processing
17:19:00 - cmdstanpy - INFO - Chain [1] start processing
17:19:00 - cmdstanpy - INFO - Chain [1] start processing
17:19:00 - cmdstanpy - INFO - Chain [1] done processing
17:19:01 - cmdstanpy - INFO - Chain [1] done processing
17:19:01 - cmdstanpy - INFO - Chain [1] done processing
17:19:01 - cmdstanpy - INFO - Chain [1] done processing
17:19:01 - cmdstanpy - INFO - Chain [1] start processing
17:19:02 - cmdstanpy - INFO - Chain [1] done processing
17:19:03 - cmdstanpy - INFO - Chain [1] start processing
17:19:03 - cmdstanpy - INFO - Chain [1] start processing
17:19:03 - cmdstanpy - INFO - Chain [1] start processing
17:19:03 - cmdstanpy - INFO - Chain [1] start processing
17:19:03 - cmdstanpy - INFO - Chain [1] done processing
17:19:03 - cmdstanpy - INFO - Chain [1] done processing
17:19:04 - cmdstanpy - INFO - Chain [1] done processing
17:19:04 - cmdstanpy - INFO - Chain [1] done processing
17:19:04 - cmdstanpy - INFO - Chain [1] start processing
17:19:05 - cmdstanpy - INFO - Chain [1] done processing
17:19:06 - cmdstanpy - INFO - Chain [1] start processing
17:19:06 - cmdstanpy - INFO - Chain [1] start processing
17:19:06 - cmdstanpy - INFO - Chain [1] start processing
17:19:06 - cmdstanpy - INFO - Chain [1] start processing
17:19:06 - cmdstanpy - INFO - Chain [1] done processing
17:19:07 - cmdstanpy - INFO - Chain [1] done processing
17:19:07 - cmdstanpy - INFO - Chain [1] done processing
17:19:07 - cmdstanpy - INFO - Chain [1] done processing
17:19:07 - cmdstanpy - INFO - Chain [1] start processing
17:19:07 - cmdstanpy - INFO - Chain [1] done processing
17:19:08 - cmdstanpy - INFO - Chain [1] start processing
17:19:08 - cmdstanpy - INFO - Chain [1] start processing
17:19:08 - cmdstanpy - INFO - Chain [1] start processing
17:19:08 - cmdstanpy - INFO - Chain [1] start processing
17:19:08 - cmdstanpy - INFO - Chain [1] done processing
17:19:08 - cmdstanpy - INFO - Chain [1] done processing
17:19:08 - cmdstanpy - INFO - Chain [1] done processing
17:19:08 - cmdstanpy - INFO - Chain [1] done processing
17:19:09 - cmdstanpy - INFO - Chain [1] start processing
17:19:09 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:10 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] done processing
17:19:10 - cmdstanpy - INFO - Chain [1] start processing
17:19:11 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] start processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:12 - cmdstanpy - INFO - Chain [1] done processing
17:19:13 - cmdstanpy - INFO - Chain [1] done processing
17:19:13 - cmdstanpy - INFO - Chain [1] start processing
17:19:13 - cmdstanpy - INFO - Chain [1] done processing
17:19:14 - cmdstanpy - INFO - Chain [1] start processing
17:19:14 - cmdstanpy - INFO - Chain [1] start processing
17:19:14 - cmdstanpy - INFO - Chain [1] start processing
17:19:14 - cmdstanpy - INFO - Chain [1] start processing
17:19:14 - cmdstanpy - INFO - Chain [1] done processing
17:19:14 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:15 - cmdstanpy - INFO - Chain [1] start processing
17:19:15 - cmdstanpy - INFO - Chain [1] done processing
17:19:16 - cmdstanpy - INFO - Chain [1] start processing
17:19:16 - cmdstanpy - INFO - Chain [1] start processing
17:19:16 - cmdstanpy - INFO - Chain [1] start processing
17:19:16 - cmdstanpy - INFO - Chain [1] start processing
17:19:16 - cmdstanpy - INFO - Chain [1] done processing
17:19:17 - cmdstanpy - INFO - Chain [1] done processing
17:19:17 - cmdstanpy - INFO - Chain [1] done processing
17:19:18 - cmdstanpy - INFO - Chain [1] done processing
17:19:18 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] done processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:19 - cmdstanpy - INFO - Chain [1] start processing
17:19:20 - cmdstanpy - INFO - Chain [1] start processing
17:19:20 - cmdstanpy - INFO - Chain [1] start processing
17:19:20 - cmdstanpy - INFO - Chain [1] done processing
17:19:20 - cmdstanpy - INFO - Chain [1] done processing
17:19:20 - cmdstanpy - INFO - Chain [1] done processing
17:19:20 - cmdstanpy - INFO - Chain [1] done processing
17:19:21 - cmdstanpy - INFO - Chain [1] start processing
17:19:21 - cmdstanpy - INFO - Chain [1] done processing
17:19:22 - cmdstanpy - INFO - Chain [1] start processing
17:19:22 - cmdstanpy - INFO - Chain [1] start processing
17:19:22 - cmdstanpy - INFO - Chain [1] start processing
17:19:22 - cmdstanpy - INFO - Chain [1] start processing
17:19:22 - cmdstanpy - INFO - Chain [1] done processing
17:19:22 - cmdstanpy - INFO - Chain [1] done processing
17:19:23 - cmdstanpy - INFO - Chain [1] done processing
17:19:23 - cmdstanpy - INFO - Chain [1] done processing
17:19:24 - cmdstanpy - INFO - Chain [1] start processing
17:19:24 - cmdstanpy - INFO - Chain [1] done processing
17:19:25 - cmdstanpy - INFO - Chain [1] start processing
17:19:25 - cmdstanpy - INFO - Chain [1] start processing
17:19:25 - cmdstanpy - INFO - Chain [1] start processing
17:19:25 - cmdstanpy - INFO - Chain [1] start processing
17:19:26 - cmdstanpy - INFO - Chain [1] done processing
17:19:26 - cmdstanpy - INFO - Chain [1] done processing
17:19:26 - cmdstanpy - INFO - Chain [1] done processing
17:19:26 - cmdstanpy - INFO - Chain [1] done processing
17:19:26 - cmdstanpy - INFO - Chain [1] start processing
17:19:26 - cmdstanpy - INFO - Chain [1] done processing
17:19:27 - cmdstanpy - INFO - Chain [1] start processing
17:19:27 - cmdstanpy - INFO - Chain [1] start processing
17:19:27 - cmdstanpy - INFO - Chain [1] start processing
17:19:27 - cmdstanpy - INFO - Chain [1] start processing
17:19:27 - cmdstanpy - INFO - Chain [1] done processing
17:19:27 - cmdstanpy - INFO - Chain [1] done processing
17:19:28 - cmdstanpy - INFO - Chain [1] done processing
17:19:28 - cmdstanpy - INFO - Chain [1] done processing
17:19:28 - cmdstanpy - INFO - Chain [1] start processing
17:19:28 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] done processing
17:19:29 - cmdstanpy - INFO - Chain [1] start processing
17:19:30 - cmdstanpy - INFO - Chain [1] done processing
17:19:31 - cmdstanpy - INFO - Chain [1] start processing
17:19:31 - cmdstanpy - INFO - Chain [1] start processing
17:19:31 - cmdstanpy - INFO - Chain [1] start processing
17:19:31 - cmdstanpy - INFO - Chain [1] start processing
17:19:31 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:32 - cmdstanpy - INFO - Chain [1] start processing
17:19:32 - cmdstanpy - INFO - Chain [1] done processing
17:19:33 - cmdstanpy - INFO - Chain [1] start processing
17:19:33 - cmdstanpy - INFO - Chain [1] start processing
17:19:33 - cmdstanpy - INFO - Chain [1] start processing
17:19:33 - cmdstanpy - INFO - Chain [1] start processing
17:19:34 - cmdstanpy - INFO - Chain [1] done processing
17:19:34 - cmdstanpy - INFO - Chain [1] done processing
17:19:34 - cmdstanpy - INFO - Chain [1] done processing
17:19:34 - cmdstanpy - INFO - Chain [1] done processing
17:19:34 - cmdstanpy - INFO - Chain [1] start processing
17:19:35 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] start processing
17:19:36 - cmdstanpy - INFO - Chain [1] start processing
17:19:36 - cmdstanpy - INFO - Chain [1] start processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] start processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:36 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] done processing
17:19:37 - cmdstanpy - INFO - Chain [1] start processing
17:19:38 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] start processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:39 - cmdstanpy - INFO - Chain [1] done processing
17:19:40 - cmdstanpy - INFO - Chain [1] done processing
17:19:40 - cmdstanpy - INFO - Chain [1] start processing
17:19:40 - cmdstanpy - INFO - Chain [1] done processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] start processing
17:19:41 - cmdstanpy - INFO - Chain [1] done processing
17:19:41 - cmdstanpy - INFO - Chain [1] done processing
17:19:42 - cmdstanpy - INFO - Chain [1] done processing
17:19:43 - cmdstanpy - INFO - Chain [1] done processing
17:19:43 - cmdstanpy - INFO - Chain [1] start processing
17:19:43 - cmdstanpy - INFO - Chain [1] done processing
17:19:44 - cmdstanpy - INFO - Chain [1] start processing
17:19:44 - cmdstanpy - INFO - Chain [1] start processing
17:19:44 - cmdstanpy - INFO - Chain [1] start processing
17:19:44 - cmdstanpy - INFO - Chain [1] start processing
17:19:45 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] done processing
17:19:45 - cmdstanpy - INFO - Chain [1] start processing
17:19:46 - cmdstanpy - INFO - Chain [1] done processing
17:19:46 - cmdstanpy - INFO - Chain [1] start processing
17:19:46 - cmdstanpy - INFO - Chain [1] start processing
17:19:47 - cmdstanpy - INFO - Chain [1] start processing
17:19:47 - cmdstanpy - INFO - Chain [1] start processing
17:19:47 - cmdstanpy - INFO - Chain [1] done processing
17:19:47 - cmdstanpy - INFO - Chain [1] done processing
17:19:47 - cmdstanpy - INFO - Chain [1] done processing
17:19:47 - cmdstanpy - INFO - Chain [1] done processing
17:19:47 - cmdstanpy - INFO - Chain [1] start processing
17:19:47 - cmdstanpy - INFO - Chain [1] done processing
17:19:48 - cmdstanpy - INFO - Chain [1] start processing
17:19:48 - cmdstanpy - INFO - Chain [1] start processing
17:19:48 - cmdstanpy - INFO - Chain [1] start processing
17:19:48 - cmdstanpy - INFO - Chain [1] start processing
17:19:48 - cmdstanpy - INFO - Chain [1] done processing
17:19:48 - cmdstanpy - INFO - Chain [1] done processing
17:19:48 - cmdstanpy - INFO - Chain [1] done processing
17:19:48 - cmdstanpy - INFO - Chain [1] done processing
17:19:48 - cmdstanpy - INFO - Chain [1] start processing
17:19:50 - cmdstanpy - INFO - Chain [1] done processing
17:19:51 - cmdstanpy - INFO - Chain [1] start processing
17:19:51 - cmdstanpy - INFO - Chain [1] start processing
17:19:51 - cmdstanpy - INFO - Chain [1] start processing
17:19:51 - cmdstanpy - INFO - Chain [1] start processing
17:19:51 - cmdstanpy - INFO - Chain [1] done processing
17:19:51 - cmdstanpy - INFO - Chain [1] done processing
17:19:51 - cmdstanpy - INFO - Chain [1] done processing
17:19:51 - cmdstanpy - INFO - Chain [1] done processing
17:19:51 - cmdstanpy - INFO - Chain [1] start processing
17:19:52 - cmdstanpy - INFO - Chain [1] done processing
17:19:52 - cmdstanpy - INFO - Chain [1] start processing
17:19:53 - cmdstanpy - INFO - Chain [1] start processing
17:19:53 - cmdstanpy - INFO - Chain [1] start processing
17:19:53 - cmdstanpy - INFO - Chain [1] start processing
17:19:53 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] done processing
17:19:53 - cmdstanpy - INFO - Chain [1] start processing
17:19:54 - cmdstanpy - INFO - Chain [1] done processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] start processing
17:19:55 - cmdstanpy - INFO - Chain [1] done processing
17:19:55 - cmdstanpy - INFO - Chain [1] done processing
17:19:55 - cmdstanpy - INFO - Chain [1] done processing
17:19:56 - cmdstanpy - INFO - Chain [1] done processing
17:19:56 - cmdstanpy - INFO - Chain [1] start processing
17:19:57 - cmdstanpy - INFO - Chain [1] done processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] start processing
17:19:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:58 - cmdstanpy - INFO - Chain [1] done processing
17:19:59 - cmdstanpy - INFO - Chain [1] done processing
17:19:59 - cmdstanpy - INFO - Chain [1] done processing
17:19:59 - cmdstanpy - INFO - Chain [1] start processing
17:19:59 - cmdstanpy - INFO - Chain [1] done processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] start processing
17:20:00 - cmdstanpy - INFO - Chain [1] done processing
17:20:00 - cmdstanpy - INFO - Chain [1] done processing
17:20:01 - cmdstanpy - INFO - Chain [1] done processing
17:20:02 - cmdstanpy - INFO - Chain [1] done processing
17:20:02 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] done processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:03 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] done processing
17:20:04 - cmdstanpy - INFO - Chain [1] start processing
17:20:05 - cmdstanpy - INFO - Chain [1] done processing
17:20:06 - cmdstanpy - INFO - Chain [1] start processing
17:20:06 - cmdstanpy - INFO - Chain [1] start processing
17:20:06 - cmdstanpy - INFO - Chain [1] start processing
17:20:06 - cmdstanpy - INFO - Chain [1] start processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:07 - cmdstanpy - INFO - Chain [1] done processing
17:20:17 - cmdstanpy - INFO - Chain [1] done processing
17:20:17 - cmdstanpy - INFO - Chain [1] start processing
17:20:18 - cmdstanpy - INFO - Chain [1] done processing
17:20:19 - cmdstanpy - INFO - Chain [1] start processing
17:20:19 - cmdstanpy - INFO - Chain [1] start processing
17:20:19 - cmdstanpy - INFO - Chain [1] start processing
17:20:19 - cmdstanpy - INFO - Chain [1] start processing
17:20:19 - cmdstanpy - INFO - Chain [1] done processing
17:20:19 - cmdstanpy - INFO - Chain [1] done processing
17:20:19 - cmdstanpy - INFO - Chain [1] done processing
17:20:20 - cmdstanpy - INFO - Chain [1] done processing
17:20:20 - cmdstanpy - INFO - Chain [1] start processing
17:20:21 - cmdstanpy - INFO - Chain [1] done processing
17:20:22 - cmdstanpy - INFO - Chain [1] start processing
17:20:22 - cmdstanpy - INFO - Chain [1] start processing
17:20:22 - cmdstanpy - INFO - Chain [1] start processing
17:20:22 - cmdstanpy - INFO - Chain [1] start processing
17:20:22 - cmdstanpy - INFO - Chain [1] done processing
17:20:22 - cmdstanpy - INFO - Chain [1] done processing
17:20:23 - cmdstanpy - INFO - Chain [1] done processing
17:20:32 - cmdstanpy - INFO - Chain [1] done processing
17:20:32 - cmdstanpy - INFO - Chain [1] start processing
17:20:33 - cmdstanpy - INFO - Chain [1] done processing
17:20:34 - cmdstanpy - INFO - Chain [1] start processing
17:20:34 - cmdstanpy - INFO - Chain [1] start processing
17:20:34 - cmdstanpy - INFO - Chain [1] start processing
17:20:34 - cmdstanpy - INFO - Chain [1] start processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:35 - cmdstanpy - INFO - Chain [1] done processing
17:20:36 - cmdstanpy - INFO - Chain [1] done processing
17:20:36 - cmdstanpy - INFO - Chain [1] start processing
17:20:37 - cmdstanpy - INFO - Chain [1] done processing
17:20:38 - cmdstanpy - INFO - Chain [1] start processing
17:20:38 - cmdstanpy - INFO - Chain [1] start processing
17:20:38 - cmdstanpy - INFO - Chain [1] start processing
17:20:38 - cmdstanpy - INFO - Chain [1] start processing
17:20:39 - cmdstanpy - INFO - Chain [1] done processing
17:20:40 - cmdstanpy - INFO - Chain [1] done processing
17:20:40 - cmdstanpy - INFO - Chain [1] done processing
17:20:49 - cmdstanpy - INFO - Chain [1] done processing
17:20:49 - cmdstanpy - INFO - Chain [1] start processing
17:20:50 - cmdstanpy - INFO - Chain [1] done processing
17:20:51 - cmdstanpy - INFO - Chain [1] start processing
17:20:51 - cmdstanpy - INFO - Chain [1] start processing
17:20:51 - cmdstanpy - INFO - Chain [1] start processing
17:20:51 - cmdstanpy - INFO - Chain [1] start processing
17:20:52 - cmdstanpy - INFO - Chain [1] done processing
17:20:52 - cmdstanpy - INFO - Chain [1] done processing
17:20:53 - cmdstanpy - INFO - Chain [1] done processing
17:21:01 - cmdstanpy - INFO - Chain [1] done processing
17:21:02 - cmdstanpy - INFO - Chain [1] start processing
17:21:03 - cmdstanpy - INFO - Chain [1] done processing
17:21:04 - cmdstanpy - INFO - Chain [1] start processing
17:21:04 - cmdstanpy - INFO - Chain [1] start processing
17:21:04 - cmdstanpy - INFO - Chain [1] start processing
17:21:04 - cmdstanpy - INFO - Chain [1] start processing
17:21:05 - cmdstanpy - INFO - Chain [1] done processing
17:21:05 - cmdstanpy - INFO - Chain [1] done processing
17:21:06 - cmdstanpy - INFO - Chain [1] done processing
17:21:15 - cmdstanpy - INFO - Chain [1] done processing
17:21:15 - cmdstanpy - INFO - Chain [1] start processing
17:21:17 - cmdstanpy - INFO - Chain [1] done processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:18 - cmdstanpy - INFO - Chain [1] start processing
17:21:19 - cmdstanpy - INFO - Chain [1] done processing
17:21:20 - cmdstanpy - INFO - Chain [1] done processing
17:21:20 - cmdstanpy - INFO - Chain [1] done processing
17:21:29 - cmdstanpy - INFO - Chain [1] done processing
17:21:29 - cmdstanpy - INFO - Chain [1] start processing
17:21:30 - cmdstanpy - INFO - Chain [1] done processing
17:21:31 - cmdstanpy - INFO - Chain [1] start processing
17:21:31 - cmdstanpy - INFO - Chain [1] start processing
17:21:31 - cmdstanpy - INFO - Chain [1] start processing
17:21:31 - cmdstanpy - INFO - Chain [1] start processing
17:21:31 - cmdstanpy - INFO - Chain [1] done processing
17:21:31 - cmdstanpy - INFO - Chain [1] done processing
17:21:31 - cmdstanpy - INFO - Chain [1] done processing
17:21:41 - cmdstanpy - INFO - Chain [1] done processing
17:21:41 - cmdstanpy - INFO - Chain [1] start processing
17:21:42 - cmdstanpy - INFO - Chain [1] done processing
17:21:43 - cmdstanpy - INFO - Chain [1] start processing
17:21:43 - cmdstanpy - INFO - Chain [1] start processing
17:21:43 - cmdstanpy - INFO - Chain [1] start processing
17:21:43 - cmdstanpy - INFO - Chain [1] start processing
17:21:43 - cmdstanpy - INFO - Chain [1] done processing
17:21:44 - cmdstanpy - INFO - Chain [1] done processing
17:21:44 - cmdstanpy - INFO - Chain [1] done processing
17:21:44 - cmdstanpy - INFO - Chain [1] done processing
17:21:44 - cmdstanpy - INFO - Chain [1] start processing
17:21:45 - cmdstanpy - INFO - Chain [1] done processing
17:21:46 - cmdstanpy - INFO - Chain [1] start processing
17:21:46 - cmdstanpy - INFO - Chain [1] start processing
17:21:46 - cmdstanpy - INFO - Chain [1] start processing
17:21:46 - cmdstanpy - INFO - Chain [1] start processing
17:21:47 - cmdstanpy - INFO - Chain [1] done processing
17:21:47 - cmdstanpy - INFO - Chain [1] done processing
17:21:47 - cmdstanpy - INFO - Chain [1] done processing
17:21:57 - cmdstanpy - INFO - Chain [1] done processing
17:21:57 - cmdstanpy - INFO - Chain [1] start processing
17:21:58 - cmdstanpy - INFO - Chain [1] done processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] start processing
17:21:59 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] done processing
17:22:00 - cmdstanpy - INFO - Chain [1] start processing
17:22:02 - cmdstanpy - INFO - Chain [1] done processing
17:22:02 - cmdstanpy - INFO - Chain [1] start processing
17:22:02 - cmdstanpy - INFO - Chain [1] start processing
17:22:03 - cmdstanpy - INFO - Chain [1] start processing
17:22:03 - cmdstanpy - INFO - Chain [1] start processing
17:22:03 - cmdstanpy - INFO - Chain [1] done processing
17:22:04 - cmdstanpy - INFO - Chain [1] done processing
17:22:05 - cmdstanpy - INFO - Chain [1] done processing
17:22:13 - cmdstanpy - INFO - Chain [1] done processing
17:22:13 - cmdstanpy - INFO - Chain [1] start processing
17:22:15 - cmdstanpy - INFO - Chain [1] done processing
17:22:15 - cmdstanpy - INFO - Chain [1] start processing
17:22:15 - cmdstanpy - INFO - Chain [1] start processing
17:22:15 - cmdstanpy - INFO - Chain [1] start processing
17:22:15 - cmdstanpy - INFO - Chain [1] start processing
17:22:17 - cmdstanpy - INFO - Chain [1] done processing
17:22:17 - cmdstanpy - INFO - Chain [1] done processing
17:22:17 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] done processing
17:22:26 - cmdstanpy - INFO - Chain [1] start processing
17:22:28 - cmdstanpy - INFO - Chain [1] done processing
17:22:29 - cmdstanpy - INFO - Chain [1] start processing
17:22:29 - cmdstanpy - INFO - Chain [1] start processing
17:22:29 - cmdstanpy - INFO - Chain [1] start processing
17:22:29 - cmdstanpy - INFO - Chain [1] start processing
17:22:30 - cmdstanpy - INFO - Chain [1] done processing
17:22:30 - cmdstanpy - INFO - Chain [1] done processing
17:22:31 - cmdstanpy - INFO - Chain [1] done processing
17:22:40 - cmdstanpy - INFO - Chain [1] done processing
17:22:40 - cmdstanpy - INFO - Chain [1] start processing
17:22:42 - cmdstanpy - INFO - Chain [1] done processing
17:22:43 - cmdstanpy - INFO - Chain [1] start processing
17:22:43 - cmdstanpy - INFO - Chain [1] start processing
17:22:43 - cmdstanpy - INFO - Chain [1] start processing
17:22:43 - cmdstanpy - INFO - Chain [1] start processing
17:22:43 - cmdstanpy - INFO - Chain [1] done processing
17:22:44 - cmdstanpy - INFO - Chain [1] done processing
17:22:45 - cmdstanpy - INFO - Chain [1] done processing
17:22:53 - cmdstanpy - INFO - Chain [1] done processing
17:22:54 - cmdstanpy - INFO - Chain [1] start processing
17:22:54 - cmdstanpy - INFO - Chain [1] done processing
17:22:55 - cmdstanpy - INFO - Chain [1] start processing
17:22:55 - cmdstanpy - INFO - Chain [1] start processing
17:22:55 - cmdstanpy - INFO - Chain [1] start processing
17:22:55 - cmdstanpy - INFO - Chain [1] start processing
17:22:56 - cmdstanpy - INFO - Chain [1] done processing
17:22:56 - cmdstanpy - INFO - Chain [1] done processing
17:22:56 - cmdstanpy - INFO - Chain [1] done processing
17:23:06 - cmdstanpy - INFO - Chain [1] done processing
17:23:06 - cmdstanpy - INFO - Chain [1] start processing
17:23:07 - cmdstanpy - INFO - Chain [1] done processing
17:23:08 - cmdstanpy - INFO - Chain [1] start processing
17:23:08 - cmdstanpy - INFO - Chain [1] start processing
17:23:08 - cmdstanpy - INFO - Chain [1] start processing
17:23:08 - cmdstanpy - INFO - Chain [1] start processing
17:23:08 - cmdstanpy - INFO - Chain [1] done processing
17:23:08 - cmdstanpy - INFO - Chain [1] done processing
17:23:09 - cmdstanpy - INFO - Chain [1] done processing
17:23:09 - cmdstanpy - INFO - Chain [1] done processing
17:23:09 - cmdstanpy - INFO - Chain [1] start processing
17:23:10 - cmdstanpy - INFO - Chain [1] done processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] start processing
17:23:11 - cmdstanpy - INFO - Chain [1] done processing
17:23:12 - cmdstanpy - INFO - Chain [1] done processing
17:23:12 - cmdstanpy - INFO - Chain [1] done processing
17:23:21 - cmdstanpy - INFO - Chain [1] done processing
17:23:22 - cmdstanpy - INFO - Chain [1] start processing
17:23:23 - cmdstanpy - INFO - Chain [1] done processing
17:23:23 - cmdstanpy - INFO - Chain [1] start processing
17:23:23 - cmdstanpy - INFO - Chain [1] start processing
17:23:23 - cmdstanpy - INFO - Chain [1] start processing
17:23:23 - cmdstanpy - INFO - Chain [1] start processing
17:23:24 - cmdstanpy - INFO - Chain [1] done processing
17:23:24 - cmdstanpy - INFO - Chain [1] done processing
17:23:25 - cmdstanpy - INFO - Chain [1] done processing
17:23:25 - cmdstanpy - INFO - Chain [1] done processing
17:23:25 - cmdstanpy - INFO - Chain [1] start processing
17:23:26 - cmdstanpy - INFO - Chain [1] done processing
17:23:27 - cmdstanpy - INFO - Chain [1] start processing
17:23:27 - cmdstanpy - INFO - Chain [1] start processing
17:23:27 - cmdstanpy - INFO - Chain [1] start processing
17:23:27 - cmdstanpy - INFO - Chain [1] start processing
17:23:28 - cmdstanpy - INFO - Chain [1] done processing
17:23:29 - cmdstanpy - INFO - Chain [1] done processing
17:23:29 - cmdstanpy - INFO - Chain [1] done processing
17:23:38 - cmdstanpy - INFO - Chain [1] done processing
17:23:38 - cmdstanpy - INFO - Chain [1] start processing
17:23:39 - cmdstanpy - INFO - Chain [1] done processing
17:23:40 - cmdstanpy - INFO - Chain [1] start processing
17:23:40 - cmdstanpy - INFO - Chain [1] start processing
17:23:40 - cmdstanpy - INFO - Chain [1] start processing
17:23:40 - cmdstanpy - INFO - Chain [1] start processing
17:23:41 - cmdstanpy - INFO - Chain [1] done processing
17:23:42 - cmdstanpy - INFO - Chain [1] done processing
17:23:42 - cmdstanpy - INFO - Chain [1] done processing
17:23:51 - cmdstanpy - INFO - Chain [1] done processing
17:23:51 - cmdstanpy - INFO - Chain [1] start processing
17:23:53 - cmdstanpy - INFO - Chain [1] done processing
17:23:53 - cmdstanpy - INFO - Chain [1] start processing
17:23:54 - cmdstanpy - INFO - Chain [1] start processing
17:23:54 - cmdstanpy - INFO - Chain [1] start processing
17:23:54 - cmdstanpy - INFO - Chain [1] start processing
17:23:55 - cmdstanpy - INFO - Chain [1] done processing
17:23:55 - cmdstanpy - INFO - Chain [1] done processing
17:23:55 - cmdstanpy - INFO - Chain [1] done processing
17:24:04 - cmdstanpy - INFO - Chain [1] done processing
17:24:05 - cmdstanpy - INFO - Chain [1] start processing
17:24:06 - cmdstanpy - INFO - Chain [1] done processing
17:24:07 - cmdstanpy - INFO - Chain [1] start processing
17:24:07 - cmdstanpy - INFO - Chain [1] start processing
17:24:07 - cmdstanpy - INFO - Chain [1] start processing
17:24:07 - cmdstanpy - INFO - Chain [1] start processing
17:24:08 - cmdstanpy - INFO - Chain [1] done processing
17:24:09 - cmdstanpy - INFO - Chain [1] done processing
17:24:09 - cmdstanpy - INFO - Chain [1] done processing
17:24:18 - cmdstanpy - INFO - Chain [1] done processing
17:24:18 - cmdstanpy - INFO - Chain [1] start processing
17:24:19 - cmdstanpy - INFO - Chain [1] done processing
17:24:20 - cmdstanpy - INFO - Chain [1] start processing
17:24:20 - cmdstanpy - INFO - Chain [1] start processing
17:24:20 - cmdstanpy - INFO - Chain [1] start processing
17:24:20 - cmdstanpy - INFO - Chain [1] start processing
17:24:20 - cmdstanpy - INFO - Chain [1] done processing
17:24:21 - cmdstanpy - INFO - Chain [1] done processing
17:24:21 - cmdstanpy - INFO - Chain [1] done processing
17:24:30 - cmdstanpy - INFO - Chain [1] done processing
17:24:31 - cmdstanpy - INFO - Chain [1] start processing
17:24:32 - cmdstanpy - INFO - Chain [1] done processing
17:24:33 - cmdstanpy - INFO - Chain [1] start processing
17:24:33 - cmdstanpy - INFO - Chain [1] start processing
17:24:33 - cmdstanpy - INFO - Chain [1] start processing
17:24:33 - cmdstanpy - INFO - Chain [1] start processing
17:24:33 - cmdstanpy - INFO - Chain [1] done processing
17:24:33 - cmdstanpy - INFO - Chain [1] done processing
17:24:33 - cmdstanpy - INFO - Chain [1] done processing
17:24:34 - cmdstanpy - INFO - Chain [1] done processing
17:24:34 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] done processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:35 - cmdstanpy - INFO - Chain [1] start processing
17:24:36 - cmdstanpy - INFO - Chain [1] done processing
17:24:36 - cmdstanpy - INFO - Chain [1] done processing
17:24:37 - cmdstanpy - INFO - Chain [1] done processing
17:24:46 - cmdstanpy - INFO - Chain [1] done processing
17:24:46 - cmdstanpy - INFO - Chain [1] start processing
17:24:47 - cmdstanpy - INFO - Chain [1] done processing
17:24:48 - cmdstanpy - INFO - Chain [1] start processing
17:24:48 - cmdstanpy - INFO - Chain [1] start processing
17:24:48 - cmdstanpy - INFO - Chain [1] start processing
17:24:48 - cmdstanpy - INFO - Chain [1] start processing
17:24:48 - cmdstanpy - INFO - Chain [1] done processing
17:24:49 - cmdstanpy - INFO - Chain [1] done processing
17:24:49 - cmdstanpy - INFO - Chain [1] done processing
17:24:49 - cmdstanpy - INFO - Chain [1] done processing
17:24:50 - cmdstanpy - INFO - Chain [1] start processing
17:24:51 - cmdstanpy - INFO - Chain [1] done processing
17:24:52 - cmdstanpy - INFO - Chain [1] start processing
17:24:52 - cmdstanpy - INFO - Chain [1] start processing
17:24:52 - cmdstanpy - INFO - Chain [1] start processing
17:24:52 - cmdstanpy - INFO - Chain [1] start processing
17:24:52 - cmdstanpy - INFO - Chain [1] done processing
17:24:54 - cmdstanpy - INFO - Chain [1] done processing
17:24:54 - cmdstanpy - INFO - Chain [1] done processing
17:25:03 - cmdstanpy - INFO - Chain [1] done processing
17:25:03 - cmdstanpy - INFO - Chain [1] start processing
17:25:04 - cmdstanpy - INFO - Chain [1] done processing
17:25:05 - cmdstanpy - INFO - Chain [1] start processing
17:25:05 - cmdstanpy - INFO - Chain [1] start processing
17:25:05 - cmdstanpy - INFO - Chain [1] start processing
17:25:05 - cmdstanpy - INFO - Chain [1] start processing
17:25:06 - cmdstanpy - INFO - Chain [1] done processing
17:25:06 - cmdstanpy - INFO - Chain [1] done processing
17:25:07 - cmdstanpy - INFO - Chain [1] done processing
17:25:16 - cmdstanpy - INFO - Chain [1] done processing
17:25:16 - cmdstanpy - INFO - Chain [1] start processing
17:25:17 - cmdstanpy - INFO - Chain [1] done processing
17:25:18 - cmdstanpy - INFO - Chain [1] start processing
17:25:18 - cmdstanpy - INFO - Chain [1] start processing
17:25:18 - cmdstanpy - INFO - Chain [1] start processing
17:25:18 - cmdstanpy - INFO - Chain [1] start processing
17:25:19 - cmdstanpy - INFO - Chain [1] done processing
17:25:19 - cmdstanpy - INFO - Chain [1] done processing
17:25:20 - cmdstanpy - INFO - Chain [1] done processing
17:25:29 - cmdstanpy - INFO - Chain [1] done processing
17:25:29 - cmdstanpy - INFO - Chain [1] start processing
17:25:31 - cmdstanpy - INFO - Chain [1] done processing
17:25:32 - cmdstanpy - INFO - Chain [1] start processing
17:25:32 - cmdstanpy - INFO - Chain [1] start processing
17:25:32 - cmdstanpy - INFO - Chain [1] start processing
17:25:32 - cmdstanpy - INFO - Chain [1] start processing
17:25:33 - cmdstanpy - INFO - Chain [1] done processing
17:25:34 - cmdstanpy - INFO - Chain [1] done processing
17:25:34 - cmdstanpy - INFO - Chain [1] done processing

Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'multiplicative'}

17:25:43 - cmdstanpy - INFO - Chain [1] done processing

Code

# Refit the model with the best parameters
final_model = Prophet(growth='logistic', **best_params1)
final_model.add_country_holidays(country_name='US')
for feature in features:
    final_model.add_regressor(feature)
final_model.fit(train.assign(cap=1, floor=0))

# Predict on the training set
train_forecast = final_model.predict(train)
train_rmse = sqrt(mean_squared_error(train['y'], train_forecast['yhat']))

# Predict on the test set
test_forecast = final_model.predict(test)
test_rmse = sqrt(mean_squared_error(test['y'], test_forecast['yhat']))

print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")
# Retrieve and print the cross-validated RMSE of the best model
best_rmse_index = np.argmin(rmses)
best_rmse = rmses[best_rmse_index]
print(f"Cross-validated RMSE of the best model: {best_rmse}")

17:26:46 - cmdstanpy - INFO - Chain [1] start processing
17:26:47 - cmdstanpy - INFO - Chain [1] done processing

Train RMSE: 0.010021219867086121
Test RMSE: 0.01684613527712839
Cross-validated RMSE of the best model: 0.011242406258430045

Here, we can see that the test RMSE greatly decreased and is very similar to the train RMSE. The best parameters I got are as follows:

'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01, 'seasonality_mode': 'multiplicative'.

Below I tune the model once more to be exhaustive.

Code

# Updated parameter grid for cross-validation tuning
param_grid = {
    'changepoint_prior_scale': [0.3, 0.4, 0.45, 0.5],
    'seasonality_prior_scale': [0.01, 0.015, 0.02, 0.025],
    'holidays_prior_scale': [0.01, 0.015, 0.02, 0.025]
}

# Generate all combinations of parameters
all_params = [dict(zip(param_grid.keys(), v)) for v in itertools.product(*param_grid.values())]
rmses = []  # Storing the RMSEs for each set of parameters 

# Cross-validation to evaluate all parameters
for params in all_params:
    # Initialize Prophet model with logistic growth and additive seasonality
    m = Prophet(growth='logistic', seasonality_mode='multiplicative', **params)
    m.add_country_holidays(country_name='US')
    
    # Add each additional regressor
    for feature in features:
        m.add_regressor(feature)
    
    # Fit the model to the training data
    m.fit(train.assign(cap=1, floor=0))

    # Perform cross-validation
    df_cv = cross_validation(m, initial='180 days', period='45 days', horizon='45 days', parallel="processes")
    df_p = performance_metrics(df_cv, rolling_window=1)

    # Store the RMSE for each parameter set
    rmses.append(df_p['rmse'].values[0])

# Identify the best parameters
best_params = all_params[np.argmin(rmses)]
print(f"Best parameters: {best_params}")

17:26:53 - cmdstanpy - INFO - Chain [1] start processing
17:26:54 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] done processing
17:26:55 - cmdstanpy - INFO - Chain [1] start processing
17:26:56 - cmdstanpy - INFO - Chain [1] done processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:57 - cmdstanpy - INFO - Chain [1] start processing
17:26:58 - cmdstanpy - INFO - Chain [1] done processing
17:26:58 - cmdstanpy - INFO - Chain [1] done processing
17:26:58 - cmdstanpy - INFO - Chain [1] done processing
17:26:59 - cmdstanpy - INFO - Chain [1] done processing
17:26:59 - cmdstanpy - INFO - Chain [1] start processing
17:27:00 - cmdstanpy - INFO - Chain [1] done processing
17:27:01 - cmdstanpy - INFO - Chain [1] start processing
17:27:01 - cmdstanpy - INFO - Chain [1] start processing
17:27:01 - cmdstanpy - INFO - Chain [1] start processing
17:27:01 - cmdstanpy - INFO - Chain [1] start processing
17:27:01 - cmdstanpy - INFO - Chain [1] done processing
17:27:01 - cmdstanpy - INFO - Chain [1] done processing
17:27:02 - cmdstanpy - INFO - Chain [1] done processing
17:27:02 - cmdstanpy - INFO - Chain [1] done processing
17:27:02 - cmdstanpy - INFO - Chain [1] start processing
17:27:03 - cmdstanpy - INFO - Chain [1] done processing
17:27:04 - cmdstanpy - INFO - Chain [1] start processing
17:27:04 - cmdstanpy - INFO - Chain [1] start processing
17:27:04 - cmdstanpy - INFO - Chain [1] start processing
17:27:04 - cmdstanpy - INFO - Chain [1] start processing
17:27:04 - cmdstanpy - INFO - Chain [1] done processing
17:27:04 - cmdstanpy - INFO - Chain [1] done processing
17:27:04 - cmdstanpy - INFO - Chain [1] done processing
17:27:04 - cmdstanpy - INFO - Chain [1] done processing
17:27:05 - cmdstanpy - INFO - Chain [1] start processing
17:27:05 - cmdstanpy - INFO - Chain [1] done processing
17:27:06 - cmdstanpy - INFO - Chain [1] start processing
17:27:06 - cmdstanpy - INFO - Chain [1] start processing
17:27:06 - cmdstanpy - INFO - Chain [1] start processing
17:27:06 - cmdstanpy - INFO - Chain [1] start processing
17:27:06 - cmdstanpy - INFO - Chain [1] done processing
17:27:07 - cmdstanpy - INFO - Chain [1] done processing
17:27:07 - cmdstanpy - INFO - Chain [1] done processing
17:27:07 - cmdstanpy - INFO - Chain [1] done processing
17:27:07 - cmdstanpy - INFO - Chain [1] start processing
17:27:08 - cmdstanpy - INFO - Chain [1] done processing
17:27:08 - cmdstanpy - INFO - Chain [1] start processing
17:27:09 - cmdstanpy - INFO - Chain [1] start processing
17:27:09 - cmdstanpy - INFO - Chain [1] start processing
17:27:09 - cmdstanpy - INFO - Chain [1] start processing
17:27:09 - cmdstanpy - INFO - Chain [1] done processing
17:27:09 - cmdstanpy - INFO - Chain [1] done processing
17:27:09 - cmdstanpy - INFO - Chain [1] done processing
17:27:10 - cmdstanpy - INFO - Chain [1] done processing
17:27:10 - cmdstanpy - INFO - Chain [1] start processing
17:27:11 - cmdstanpy - INFO - Chain [1] done processing
17:27:12 - cmdstanpy - INFO - Chain [1] start processing
17:27:12 - cmdstanpy - INFO - Chain [1] start processing
17:27:12 - cmdstanpy - INFO - Chain [1] start processing
17:27:12 - cmdstanpy - INFO - Chain [1] start processing
17:27:13 - cmdstanpy - INFO - Chain [1] done processing
17:27:13 - cmdstanpy - INFO - Chain [1] done processing
17:27:13 - cmdstanpy - INFO - Chain [1] done processing
17:27:13 - cmdstanpy - INFO - Chain [1] done processing
17:27:13 - cmdstanpy - INFO - Chain [1] start processing
17:27:14 - cmdstanpy - INFO - Chain [1] done processing
17:27:15 - cmdstanpy - INFO - Chain [1] start processing
17:27:15 - cmdstanpy - INFO - Chain [1] start processing
17:27:15 - cmdstanpy - INFO - Chain [1] start processing
17:27:15 - cmdstanpy - INFO - Chain [1] start processing
17:27:16 - cmdstanpy - INFO - Chain [1] done processing
17:27:16 - cmdstanpy - INFO - Chain [1] done processing
17:27:16 - cmdstanpy - INFO - Chain [1] done processing
17:27:16 - cmdstanpy - INFO - Chain [1] done processing
17:27:16 - cmdstanpy - INFO - Chain [1] start processing
17:27:17 - cmdstanpy - INFO - Chain [1] done processing
17:27:17 - cmdstanpy - INFO - Chain [1] start processing
17:27:18 - cmdstanpy - INFO - Chain [1] start processing
17:27:18 - cmdstanpy - INFO - Chain [1] start processing
17:27:18 - cmdstanpy - INFO - Chain [1] start processing
17:27:18 - cmdstanpy - INFO - Chain [1] done processing
17:27:18 - cmdstanpy - INFO - Chain [1] done processing
17:27:18 - cmdstanpy - INFO - Chain [1] done processing
17:27:18 - cmdstanpy - INFO - Chain [1] done processing
17:27:18 - cmdstanpy - INFO - Chain [1] start processing
17:27:19 - cmdstanpy - INFO - Chain [1] done processing
17:27:20 - cmdstanpy - INFO - Chain [1] start processing
17:27:20 - cmdstanpy - INFO - Chain [1] start processing
17:27:20 - cmdstanpy - INFO - Chain [1] start processing
17:27:20 - cmdstanpy - INFO - Chain [1] start processing
17:27:20 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] done processing
17:27:21 - cmdstanpy - INFO - Chain [1] start processing
17:27:23 - cmdstanpy - INFO - Chain [1] done processing
17:27:23 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] start processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:24 - cmdstanpy - INFO - Chain [1] done processing
17:27:25 - cmdstanpy - INFO - Chain [1] start processing
17:27:25 - cmdstanpy - INFO - Chain [1] done processing
17:27:26 - cmdstanpy - INFO - Chain [1] start processing
17:27:26 - cmdstanpy - INFO - Chain [1] start processing
17:27:26 - cmdstanpy - INFO - Chain [1] start processing
17:27:26 - cmdstanpy - INFO - Chain [1] start processing
17:27:27 - cmdstanpy - INFO - Chain [1] done processing
17:27:27 - cmdstanpy - INFO - Chain [1] done processing
17:27:27 - cmdstanpy - INFO - Chain [1] done processing
17:27:27 - cmdstanpy - INFO - Chain [1] done processing
17:27:27 - cmdstanpy - INFO - Chain [1] start processing
17:27:28 - cmdstanpy - INFO - Chain [1] done processing
17:27:29 - cmdstanpy - INFO - Chain [1] start processing
17:27:29 - cmdstanpy - INFO - Chain [1] start processing
17:27:29 - cmdstanpy - INFO - Chain [1] start processing
17:27:29 - cmdstanpy - INFO - Chain [1] start processing
17:27:29 - cmdstanpy - INFO - Chain [1] done processing
17:27:29 - cmdstanpy - INFO - Chain [1] done processing
17:27:29 - cmdstanpy - INFO - Chain [1] done processing
17:27:29 - cmdstanpy - INFO - Chain [1] done processing
17:27:29 - cmdstanpy - INFO - Chain [1] start processing
17:27:30 - cmdstanpy - INFO - Chain [1] done processing
17:27:31 - cmdstanpy - INFO - Chain [1] start processing
17:27:31 - cmdstanpy - INFO - Chain [1] start processing
17:27:31 - cmdstanpy - INFO - Chain [1] start processing
17:27:31 - cmdstanpy - INFO - Chain [1] start processing
17:27:32 - cmdstanpy - INFO - Chain [1] done processing
17:27:32 - cmdstanpy - INFO - Chain [1] done processing
17:27:32 - cmdstanpy - INFO - Chain [1] done processing
17:27:33 - cmdstanpy - INFO - Chain [1] done processing
17:27:33 - cmdstanpy - INFO - Chain [1] start processing
17:27:34 - cmdstanpy - INFO - Chain [1] done processing
17:27:35 - cmdstanpy - INFO - Chain [1] start processing
17:27:35 - cmdstanpy - INFO - Chain [1] start processing
17:27:35 - cmdstanpy - INFO - Chain [1] start processing
17:27:35 - cmdstanpy - INFO - Chain [1] start processing
17:27:35 - cmdstanpy - INFO - Chain [1] done processing
17:27:35 - cmdstanpy - INFO - Chain [1] done processing
17:27:36 - cmdstanpy - INFO - Chain [1] done processing
17:27:36 - cmdstanpy - INFO - Chain [1] done processing
17:27:36 - cmdstanpy - INFO - Chain [1] start processing
17:27:37 - cmdstanpy - INFO - Chain [1] done processing
17:27:38 - cmdstanpy - INFO - Chain [1] start processing
17:27:38 - cmdstanpy - INFO - Chain [1] start processing
17:27:38 - cmdstanpy - INFO - Chain [1] start processing
17:27:38 - cmdstanpy - INFO - Chain [1] start processing
17:27:38 - cmdstanpy - INFO - Chain [1] done processing
17:27:38 - cmdstanpy - INFO - Chain [1] done processing
17:27:38 - cmdstanpy - INFO - Chain [1] done processing
17:27:38 - cmdstanpy - INFO - Chain [1] done processing
17:27:38 - cmdstanpy - INFO - Chain [1] start processing
17:27:39 - cmdstanpy - INFO - Chain [1] done processing
17:27:40 - cmdstanpy - INFO - Chain [1] start processing
17:27:40 - cmdstanpy - INFO - Chain [1] start processing
17:27:40 - cmdstanpy - INFO - Chain [1] start processing
17:27:40 - cmdstanpy - INFO - Chain [1] start processing
17:27:41 - cmdstanpy - INFO - Chain [1] done processing
17:27:41 - cmdstanpy - INFO - Chain [1] done processing
17:27:41 - cmdstanpy - INFO - Chain [1] done processing
17:27:41 - cmdstanpy - INFO - Chain [1] done processing
17:27:41 - cmdstanpy - INFO - Chain [1] start processing
17:27:42 - cmdstanpy - INFO - Chain [1] done processing
17:27:43 - cmdstanpy - INFO - Chain [1] start processing
17:27:43 - cmdstanpy - INFO - Chain [1] start processing
17:27:43 - cmdstanpy - INFO - Chain [1] start processing
17:27:43 - cmdstanpy - INFO - Chain [1] start processing
17:27:43 - cmdstanpy - INFO - Chain [1] done processing
17:27:44 - cmdstanpy - INFO - Chain [1] done processing
17:27:44 - cmdstanpy - INFO - Chain [1] done processing
17:27:45 - cmdstanpy - INFO - Chain [1] done processing
17:27:45 - cmdstanpy - INFO - Chain [1] start processing
17:27:46 - cmdstanpy - INFO - Chain [1] done processing
17:27:46 - cmdstanpy - INFO - Chain [1] start processing
17:27:46 - cmdstanpy - INFO - Chain [1] start processing
17:27:46 - cmdstanpy - INFO - Chain [1] start processing
17:27:46 - cmdstanpy - INFO - Chain [1] start processing
17:27:47 - cmdstanpy - INFO - Chain [1] done processing
17:27:47 - cmdstanpy - INFO - Chain [1] done processing
17:27:47 - cmdstanpy - INFO - Chain [1] done processing
17:27:47 - cmdstanpy - INFO - Chain [1] done processing
17:27:48 - cmdstanpy - INFO - Chain [1] start processing
17:27:49 - cmdstanpy - INFO - Chain [1] done processing
17:27:50 - cmdstanpy - INFO - Chain [1] start processing
17:27:50 - cmdstanpy - INFO - Chain [1] start processing
17:27:50 - cmdstanpy - INFO - Chain [1] start processing
17:27:50 - cmdstanpy - INFO - Chain [1] start processing
17:27:50 - cmdstanpy - INFO - Chain [1] done processing
17:27:50 - cmdstanpy - INFO - Chain [1] done processing
17:27:50 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] done processing
17:27:51 - cmdstanpy - INFO - Chain [1] start processing
17:27:52 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:53 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] done processing
17:27:53 - cmdstanpy - INFO - Chain [1] start processing
17:27:55 - cmdstanpy - INFO - Chain [1] done processing
17:27:55 - cmdstanpy - INFO - Chain [1] start processing
17:27:55 - cmdstanpy - INFO - Chain [1] start processing
17:27:55 - cmdstanpy - INFO - Chain [1] start processing
17:27:55 - cmdstanpy - INFO - Chain [1] start processing
17:27:56 - cmdstanpy - INFO - Chain [1] done processing
17:27:56 - cmdstanpy - INFO - Chain [1] done processing
17:27:57 - cmdstanpy - INFO - Chain [1] done processing
17:27:57 - cmdstanpy - INFO - Chain [1] done processing
17:27:57 - cmdstanpy - INFO - Chain [1] start processing
17:27:58 - cmdstanpy - INFO - Chain [1] done processing
17:27:59 - cmdstanpy - INFO - Chain [1] start processing
17:27:59 - cmdstanpy - INFO - Chain [1] start processing
17:27:59 - cmdstanpy - INFO - Chain [1] start processing
17:27:59 - cmdstanpy - INFO - Chain [1] start processing
17:27:59 - cmdstanpy - INFO - Chain [1] done processing
17:27:59 - cmdstanpy - INFO - Chain [1] done processing
17:27:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] done processing
17:28:00 - cmdstanpy - INFO - Chain [1] start processing
17:28:01 - cmdstanpy - INFO - Chain [1] done processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] start processing
17:28:02 - cmdstanpy - INFO - Chain [1] done processing
17:28:02 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] done processing
17:28:03 - cmdstanpy - INFO - Chain [1] start processing
17:28:04 - cmdstanpy - INFO - Chain [1] done processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] start processing
17:28:05 - cmdstanpy - INFO - Chain [1] done processing
17:28:05 - cmdstanpy - INFO - Chain [1] done processing
17:28:06 - cmdstanpy - INFO - Chain [1] done processing
17:28:06 - cmdstanpy - INFO - Chain [1] done processing
17:28:06 - cmdstanpy - INFO - Chain [1] start processing
17:28:07 - cmdstanpy - INFO - Chain [1] done processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] start processing
17:28:08 - cmdstanpy - INFO - Chain [1] done processing
17:28:08 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] done processing
17:28:09 - cmdstanpy - INFO - Chain [1] start processing
17:28:10 - cmdstanpy - INFO - Chain [1] done processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] start processing
17:28:11 - cmdstanpy - INFO - Chain [1] done processing
17:28:11 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] done processing
17:28:12 - cmdstanpy - INFO - Chain [1] start processing
17:28:13 - cmdstanpy - INFO - Chain [1] done processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] start processing
17:28:14 - cmdstanpy - INFO - Chain [1] done processing
17:28:15 - cmdstanpy - INFO - Chain [1] done processing
17:28:15 - cmdstanpy - INFO - Chain [1] done processing
17:28:15 - cmdstanpy - INFO - Chain [1] done processing
17:28:15 - cmdstanpy - INFO - Chain [1] start processing
17:28:16 - cmdstanpy - INFO - Chain [1] done processing
17:28:17 - cmdstanpy - INFO - Chain [1] start processing
17:28:17 - cmdstanpy - INFO - Chain [1] start processing
17:28:17 - cmdstanpy - INFO - Chain [1] start processing
17:28:17 - cmdstanpy - INFO - Chain [1] start processing
17:28:18 - cmdstanpy - INFO - Chain [1] done processing
17:28:18 - cmdstanpy - INFO - Chain [1] done processing
17:28:18 - cmdstanpy - INFO - Chain [1] done processing
17:28:18 - cmdstanpy - INFO - Chain [1] done processing
17:28:18 - cmdstanpy - INFO - Chain [1] start processing
17:28:19 - cmdstanpy - INFO - Chain [1] done processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] start processing
17:28:20 - cmdstanpy - INFO - Chain [1] done processing
17:28:21 - cmdstanpy - INFO - Chain [1] done processing
17:28:21 - cmdstanpy - INFO - Chain [1] done processing
17:28:21 - cmdstanpy - INFO - Chain [1] done processing
17:28:22 - cmdstanpy - INFO - Chain [1] start processing
17:28:22 - cmdstanpy - INFO - Chain [1] done processing
17:28:23 - cmdstanpy - INFO - Chain [1] start processing
17:28:23 - cmdstanpy - INFO - Chain [1] start processing
17:28:23 - cmdstanpy - INFO - Chain [1] start processing
17:28:23 - cmdstanpy - INFO - Chain [1] start processing
17:28:24 - cmdstanpy - INFO - Chain [1] done processing
17:28:24 - cmdstanpy - INFO - Chain [1] done processing
17:28:24 - cmdstanpy - INFO - Chain [1] done processing
17:28:24 - cmdstanpy - INFO - Chain [1] done processing
17:28:24 - cmdstanpy - INFO - Chain [1] start processing
17:28:26 - cmdstanpy - INFO - Chain [1] done processing
17:28:26 - cmdstanpy - INFO - Chain [1] start processing
17:28:26 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] start processing
17:28:27 - cmdstanpy - INFO - Chain [1] done processing
17:28:27 - cmdstanpy - INFO - Chain [1] done processing
17:28:27 - cmdstanpy - INFO - Chain [1] done processing
17:28:28 - cmdstanpy - INFO - Chain [1] done processing
17:28:28 - cmdstanpy - INFO - Chain [1] start processing
17:28:29 - cmdstanpy - INFO - Chain [1] done processing
17:28:30 - cmdstanpy - INFO - Chain [1] start processing
17:28:30 - cmdstanpy - INFO - Chain [1] start processing
17:28:30 - cmdstanpy - INFO - Chain [1] start processing
17:28:30 - cmdstanpy - INFO - Chain [1] start processing
17:28:30 - cmdstanpy - INFO - Chain [1] done processing
17:28:30 - cmdstanpy - INFO - Chain [1] done processing
17:28:30 - cmdstanpy - INFO - Chain [1] done processing
17:28:30 - cmdstanpy - INFO - Chain [1] done processing
17:28:31 - cmdstanpy - INFO - Chain [1] start processing
17:28:32 - cmdstanpy - INFO - Chain [1] done processing
17:28:33 - cmdstanpy - INFO - Chain [1] start processing
17:28:33 - cmdstanpy - INFO - Chain [1] start processing
17:28:33 - cmdstanpy - INFO - Chain [1] start processing
17:28:33 - cmdstanpy - INFO - Chain [1] start processing
17:28:33 - cmdstanpy - INFO - Chain [1] done processing
17:28:33 - cmdstanpy - INFO - Chain [1] done processing
17:28:33 - cmdstanpy - INFO - Chain [1] done processing
17:28:34 - cmdstanpy - INFO - Chain [1] done processing
17:28:34 - cmdstanpy - INFO - Chain [1] start processing
17:28:35 - cmdstanpy - INFO - Chain [1] done processing
17:28:36 - cmdstanpy - INFO - Chain [1] start processing
17:28:36 - cmdstanpy - INFO - Chain [1] start processing
17:28:36 - cmdstanpy - INFO - Chain [1] start processing
17:28:36 - cmdstanpy - INFO - Chain [1] start processing
17:28:36 - cmdstanpy - INFO - Chain [1] done processing
17:28:36 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] done processing
17:28:37 - cmdstanpy - INFO - Chain [1] start processing
17:28:38 - cmdstanpy - INFO - Chain [1] done processing
17:28:39 - cmdstanpy - INFO - Chain [1] start processing
17:28:39 - cmdstanpy - INFO - Chain [1] start processing
17:28:39 - cmdstanpy - INFO - Chain [1] start processing
17:28:39 - cmdstanpy - INFO - Chain [1] start processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:40 - cmdstanpy - INFO - Chain [1] done processing
17:28:40 - cmdstanpy - INFO - Chain [1] start processing
17:28:41 - cmdstanpy - INFO - Chain [1] done processing
17:28:42 - cmdstanpy - INFO - Chain [1] start processing
17:28:42 - cmdstanpy - INFO - Chain [1] start processing
17:28:42 - cmdstanpy - INFO - Chain [1] start processing
17:28:42 - cmdstanpy - INFO - Chain [1] start processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] done processing
17:28:43 - cmdstanpy - INFO - Chain [1] start processing
17:28:44 - cmdstanpy - INFO - Chain [1] done processing
17:28:45 - cmdstanpy - INFO - Chain [1] start processing
17:28:45 - cmdstanpy - INFO - Chain [1] start processing
17:28:45 - cmdstanpy - INFO - Chain [1] start processing
17:28:45 - cmdstanpy - INFO - Chain [1] start processing
17:28:45 - cmdstanpy - INFO - Chain [1] done processing
17:28:46 - cmdstanpy - INFO - Chain [1] done processing
17:28:46 - cmdstanpy - INFO - Chain [1] done processing
17:28:46 - cmdstanpy - INFO - Chain [1] done processing
17:28:46 - cmdstanpy - INFO - Chain [1] start processing
17:28:47 - cmdstanpy - INFO - Chain [1] done processing
17:28:48 - cmdstanpy - INFO - Chain [1] start processing
17:28:48 - cmdstanpy - INFO - Chain [1] start processing
17:28:48 - cmdstanpy - INFO - Chain [1] start processing
17:28:48 - cmdstanpy - INFO - Chain [1] start processing
17:28:48 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] done processing
17:28:49 - cmdstanpy - INFO - Chain [1] start processing
17:28:51 - cmdstanpy - INFO - Chain [1] done processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] start processing
17:28:52 - cmdstanpy - INFO - Chain [1] done processing
17:28:52 - cmdstanpy - INFO - Chain [1] done processing
17:28:52 - cmdstanpy - INFO - Chain [1] done processing
17:28:53 - cmdstanpy - INFO - Chain [1] done processing
17:28:53 - cmdstanpy - INFO - Chain [1] start processing
17:28:54 - cmdstanpy - INFO - Chain [1] done processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] start processing
17:28:55 - cmdstanpy - INFO - Chain [1] done processing
17:28:55 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] done processing
17:28:56 - cmdstanpy - INFO - Chain [1] start processing
17:28:57 - cmdstanpy - INFO - Chain [1] done processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] start processing
17:28:58 - cmdstanpy - INFO - Chain [1] done processing
17:28:58 - cmdstanpy - INFO - Chain [1] done processing
17:28:58 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] done processing
17:28:59 - cmdstanpy - INFO - Chain [1] start processing
17:29:00 - cmdstanpy - INFO - Chain [1] done processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] start processing
17:29:01 - cmdstanpy - INFO - Chain [1] done processing
17:29:01 - cmdstanpy - INFO - Chain [1] done processing
17:29:01 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] done processing
17:29:02 - cmdstanpy - INFO - Chain [1] start processing
17:29:03 - cmdstanpy - INFO - Chain [1] done processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:04 - cmdstanpy - INFO - Chain [1] start processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] done processing
17:29:05 - cmdstanpy - INFO - Chain [1] start processing
17:29:06 - cmdstanpy - INFO - Chain [1] done processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:07 - cmdstanpy - INFO - Chain [1] start processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] done processing
17:29:08 - cmdstanpy - INFO - Chain [1] start processing
17:29:09 - cmdstanpy - INFO - Chain [1] done processing
17:29:10 - cmdstanpy - INFO - Chain [1] start processing
17:29:10 - cmdstanpy - INFO - Chain [1] start processing
17:29:10 - cmdstanpy - INFO - Chain [1] start processing
17:29:10 - cmdstanpy - INFO - Chain [1] start processing
17:29:10 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] done processing
17:29:11 - cmdstanpy - INFO - Chain [1] start processing
17:29:12 - cmdstanpy - INFO - Chain [1] done processing
17:29:13 - cmdstanpy - INFO - Chain [1] start processing
17:29:13 - cmdstanpy - INFO - Chain [1] start processing
17:29:13 - cmdstanpy - INFO - Chain [1] start processing
17:29:13 - cmdstanpy - INFO - Chain [1] start processing
17:29:13 - cmdstanpy - INFO - Chain [1] done processing
17:29:13 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] done processing
17:29:14 - cmdstanpy - INFO - Chain [1] start processing
17:29:16 - cmdstanpy - INFO - Chain [1] done processing
17:29:17 - cmdstanpy - INFO - Chain [1] start processing
17:29:17 - cmdstanpy - INFO - Chain [1] start processing
17:29:17 - cmdstanpy - INFO - Chain [1] start processing
17:29:17 - cmdstanpy - INFO - Chain [1] start processing
17:29:17 - cmdstanpy - INFO - Chain [1] done processing
17:29:17 - cmdstanpy - INFO - Chain [1] done processing
17:29:17 - cmdstanpy - INFO - Chain [1] done processing
17:29:18 - cmdstanpy - INFO - Chain [1] done processing
17:29:18 - cmdstanpy - INFO - Chain [1] start processing
17:29:19 - cmdstanpy - INFO - Chain [1] done processing
17:29:19 - cmdstanpy - INFO - Chain [1] start processing
17:29:19 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] start processing
17:29:20 - cmdstanpy - INFO - Chain [1] done processing
17:29:20 - cmdstanpy - INFO - Chain [1] done processing
17:29:20 - cmdstanpy - INFO - Chain [1] done processing
17:29:21 - cmdstanpy - INFO - Chain [1] done processing
17:29:21 - cmdstanpy - INFO - Chain [1] start processing
17:29:22 - cmdstanpy - INFO - Chain [1] done processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] start processing
17:29:23 - cmdstanpy - INFO - Chain [1] done processing
17:29:23 - cmdstanpy - INFO - Chain [1] done processing
17:29:23 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] done processing
17:29:24 - cmdstanpy - INFO - Chain [1] start processing
17:29:25 - cmdstanpy - INFO - Chain [1] done processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] start processing
17:29:26 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] done processing
17:29:27 - cmdstanpy - INFO - Chain [1] start processing
17:29:28 - cmdstanpy - INFO - Chain [1] done processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] start processing
17:29:29 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] done processing
17:29:30 - cmdstanpy - INFO - Chain [1] start processing
17:29:31 - cmdstanpy - INFO - Chain [1] done processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:32 - cmdstanpy - INFO - Chain [1] start processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] done processing
17:29:33 - cmdstanpy - INFO - Chain [1] start processing
17:29:35 - cmdstanpy - INFO - Chain [1] done processing
17:29:35 - cmdstanpy - INFO - Chain [1] start processing
17:29:35 - cmdstanpy - INFO - Chain [1] start processing
17:29:35 - cmdstanpy - INFO - Chain [1] start processing
17:29:35 - cmdstanpy - INFO - Chain [1] start processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:36 - cmdstanpy - INFO - Chain [1] done processing
17:29:37 - cmdstanpy - INFO - Chain [1] done processing
17:29:37 - cmdstanpy - INFO - Chain [1] start processing
17:29:38 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] start processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:39 - cmdstanpy - INFO - Chain [1] done processing
17:29:40 - cmdstanpy - INFO - Chain [1] done processing
17:29:40 - cmdstanpy - INFO - Chain [1] done processing
17:29:40 - cmdstanpy - INFO - Chain [1] start processing
17:29:41 - cmdstanpy - INFO - Chain [1] done processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] start processing
17:29:42 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] done processing
17:29:43 - cmdstanpy - INFO - Chain [1] start processing
17:29:44 - cmdstanpy - INFO - Chain [1] done processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] start processing
17:29:45 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] done processing
17:29:46 - cmdstanpy - INFO - Chain [1] start processing
17:29:47 - cmdstanpy - INFO - Chain [1] done processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:48 - cmdstanpy - INFO - Chain [1] start processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:49 - cmdstanpy - INFO - Chain [1] done processing
17:29:50 - cmdstanpy - INFO - Chain [1] done processing
17:29:50 - cmdstanpy - INFO - Chain [1] start processing
17:29:51 - cmdstanpy - INFO - Chain [1] done processing
17:29:51 - cmdstanpy - INFO - Chain [1] start processing
17:29:52 - cmdstanpy - INFO - Chain [1] start processing
17:29:52 - cmdstanpy - INFO - Chain [1] start processing
17:29:52 - cmdstanpy - INFO - Chain [1] start processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:52 - cmdstanpy - INFO - Chain [1] done processing
17:29:53 - cmdstanpy - INFO - Chain [1] done processing
17:29:53 - cmdstanpy - INFO - Chain [1] done processing
17:29:53 - cmdstanpy - INFO - Chain [1] start processing
17:29:54 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] start processing
17:29:55 - cmdstanpy - INFO - Chain [1] start processing
17:29:55 - cmdstanpy - INFO - Chain [1] start processing
17:29:55 - cmdstanpy - INFO - Chain [1] start processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:55 - cmdstanpy - INFO - Chain [1] done processing
17:29:56 - cmdstanpy - INFO - Chain [1] done processing
17:29:56 - cmdstanpy - INFO - Chain [1] done processing
17:29:56 - cmdstanpy - INFO - Chain [1] start processing
17:29:57 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] start processing
17:29:58 - cmdstanpy - INFO - Chain [1] start processing
17:29:58 - cmdstanpy - INFO - Chain [1] start processing
17:29:58 - cmdstanpy - INFO - Chain [1] start processing
17:29:58 - cmdstanpy - INFO - Chain [1] done processing
17:29:58 - cmdstanpy - INFO - Chain [1] done processing
17:29:59 - cmdstanpy - INFO - Chain [1] done processing
17:29:59 - cmdstanpy - INFO - Chain [1] done processing
17:29:59 - cmdstanpy - INFO - Chain [1] start processing
17:30:00 - cmdstanpy - INFO - Chain [1] done processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] start processing
17:30:01 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] done processing
17:30:02 - cmdstanpy - INFO - Chain [1] done processing
17:30:03 - cmdstanpy - INFO - Chain [1] done processing
17:30:03 - cmdstanpy - INFO - Chain [1] start processing
17:30:03 - cmdstanpy - INFO - Chain [1] done processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:04 - cmdstanpy - INFO - Chain [1] start processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:05 - cmdstanpy - INFO - Chain [1] done processing
17:30:06 - cmdstanpy - INFO - Chain [1] start processing
17:30:07 - cmdstanpy - INFO - Chain [1] done processing
17:30:08 - cmdstanpy - INFO - Chain [1] start processing
17:30:08 - cmdstanpy - INFO - Chain [1] start processing
17:30:08 - cmdstanpy - INFO - Chain [1] start processing
17:30:08 - cmdstanpy - INFO - Chain [1] start processing
17:30:08 - cmdstanpy - INFO - Chain [1] done processing
17:30:08 - cmdstanpy - INFO - Chain [1] done processing
17:30:09 - cmdstanpy - INFO - Chain [1] done processing

Best parameters: {'changepoint_prior_scale': 0.5, 'seasonality_prior_scale': 0.01, 'holidays_prior_scale': 0.01}

17:30:09 - cmdstanpy - INFO - Chain [1] done processing

Code

# Refit the model with the best parameters
final_model = Prophet(growth='logistic', **best_params)
final_model.add_country_holidays(country_name='US')
for feature in features:
    final_model.add_regressor(feature)
final_model.fit(train.assign(cap=1, floor=0))

# Predict on the training set
train_forecast = final_model.predict(train)
train_rmse = sqrt(mean_squared_error(train['y'], train_forecast['yhat']))

# Predict on the test set
test_forecast = final_model.predict(test)
test_rmse = sqrt(mean_squared_error(test['y'], test_forecast['yhat']))

print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")
# Retrieve and print the cross-validated RMSE of the best model
best_rmse_index = np.argmin(rmses)
best_rmse = rmses[best_rmse_index]
print(f"Cross-validated RMSE of the best model: {best_rmse}")

17:34:30 - cmdstanpy - INFO - Chain [1] start processing
17:34:31 - cmdstanpy - INFO - Chain [1] done processing

Train RMSE: 0.0063968552187190315
Test RMSE: 0.10680624649090134
Cross-validated RMSE of the best model: 0.011242406258430045

After extensive tuning, the optimal parameters for the Prophet model are:

• 'changepoint_prior_scale': 0.5
• 'seasonality_prior_scale': 0.01
• 'holidays_prior_scale': 0.01
• seasonality_mode: 'multiplicative'

A 'changepoint_prior_scale' of 0.5 implies maximum flexibility in capturing trend changes, allowing the model to quickly adapt to shifts in the data. Conversely, a 'seasonality_prior_scale' and 'holidays_prior_scale' of 0.01 introduce a high level of regularization. This minimal seasonality and holiday flexibility help prevent the model from overfitting seasonal patterns and holiday effects.

The 'multiplicative' seasonality_mode means that the model interprets seasonal effects as proportional to the time series level, a useful feature for data with varying seasonal amplitude.

Despite these adjustments, the model still exhibited signs of overfitting, as evidenced by the significant disparity between the training and testing RMSEs, and between the training RMSE and cross-validated RMSE. Multiple rounds of tuning were conducted to address this, but the gap persisted. This suggests that the overfitting may be inherent to the dataset’s characteristics or due to other factors not fully mitigated by parameter adjustments.

1.3.4.3 3. Model Performance

After tuning, the best parameters for the best multivariate Prophet model, I found slightly differ from the ones used in my best univariate Prophet model. In this model, the trends are more flexible, the seasonality flexibility is the same, and the holiday parameter has maximum regularization, higher than that of the univariate model. Also, the multivariate model uses multiplicative seasonality as opposed to additive. The increased flexibility in trends makes sense to me as additional regressors can both cause the model to be more flexible and better adapt to the additional variables and non-linear interactions between the primary time series and additional regressors. I infer that the additional regressors may cause interactions between holiday effects and other regressors which require a heightened level of regularization to prevent overfitting. Finally, I think that the multivariate model may perform better with multiplicative seasonality as opposed to the univeriate’s additive seasonality because seasonal effects may be amplified by additional regressors.

The best test RMSE for my multivariate model is 0.10680624649090134 and the cross-validated RMSE is 0.011242406258430045. It appears that there is evidence of overfitting in this model as well as most that I have created as the test RMSE is much higher than the train RMSE. The RMSEs for the multivariate Prophet model are lower than those of the univariate version. I believe this is because of the access to more information with the addition of other regressors. However, I think these additional regressors also contributed to the overfitting that is apparent in the multivariate Prophet model and absent in its univariate counterpart.

Code

# Test and Train RMSE
print(f"Train RMSE: {train_rmse}")
print(f"Test RMSE: {test_rmse}")

# Print the cross-validated RMSE of the best model
best_rmse = min(rmses)
print(f"Cross-validated RMSE of the best model: {best_rmse}")

# Plotting the actual vs predicted values for the training set
plt.figure(figsize=(15, 6))
plt.plot(train['ds'], train['y'], label='Actual')
plt.plot(train_forecast['ds'], train_forecast['yhat'], label='Predicted')
plt.title('Training Set: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Values')
plt.legend()
plt.show()


# Plotting the actual vs predicted values for the test set
plt.figure(figsize=(15, 6))
plt.plot(test['ds'], test['y'], label='Actual')
plt.plot(test_forecast['ds'], test_forecast['yhat'], label='Predicted')
plt.title('Test Set: Actual vs Predicted')
plt.xlabel('Date')
plt.ylabel('Values')
plt.legend()
plt.show()

Train RMSE: 0.0063968552187190315
Test RMSE: 0.10680624649090134
Cross-validated RMSE of the best model: 0.011242406258430045

Code

# Perform cross-validation
df_cv = cross_validation(final_model, initial='180 days', period='45 days', horizon='45 days', parallel="processes")

# Calculate performance metrics
df_p = performance_metrics(df_cv)

# Calculate and print RMSE
rmse = sqrt(mean_squared_error(df_cv['y'], df_cv['yhat']))
print(f'Cross-Validation RMSE: {rmse}')

df_p

18:02:48 - cmdstanpy - INFO - Chain [1] start processing
18:02:49 - cmdstanpy - INFO - Chain [1] start processing
18:02:49 - cmdstanpy - INFO - Chain [1] start processing
18:02:49 - cmdstanpy - INFO - Chain [1] start processing
18:02:49 - cmdstanpy - INFO - Chain [1] done processing
18:02:49 - cmdstanpy - INFO - Chain [1] done processing
18:02:49 - cmdstanpy - INFO - Chain [1] done processing

Cross-Validation RMSE: 0.01737289454707667

18:02:59 - cmdstanpy - INFO - Chain [1] done processing

	horizon	mse	rmse	mae	mape	mdape	smape	coverage
0	3 days	0.000002	0.001353	0.001353	0.001468	0.001468	0.001469	1.0
1	5 days	0.000003	0.001773	0.001731	0.001946	0.001946	0.001948	0.5
2	6 days	0.000007	0.002575	0.002539	0.002832	0.002832	0.002836	0.0
3	9 days	0.000013	0.003606	0.003557	0.003893	0.003893	0.003890	0.0
4	10 days	0.000012	0.003441	0.003346	0.003636	0.003636	0.003632	0.0
5	12 days	0.000014	0.003758	0.003605	0.004045	0.004045	0.004054	0.0
6	13 days	0.000011	0.003301	0.002356	0.002725	0.002725	0.002732	0.5
7	16 days	0.000070	0.008388	0.005954	0.006543	0.006543	0.006501	0.5
8	17 days	0.000084	0.009139	0.008496	0.009219	0.009219	0.009184	0.0
9	19 days	0.000039	0.006236	0.006151	0.006825	0.006825	0.006849	0.0
10	20 days	0.000047	0.006850	0.006842	0.007631	0.007631	0.007635	0.0
11	23 days	0.000166	0.012885	0.011765	0.012828	0.012828	0.012730	0.0
12	24 days	0.000165	0.012840	0.011676	0.012639	0.012639	0.012564	0.5
13	26 days	0.000062	0.007870	0.007743	0.008555	0.008555	0.008593	1.0
14	27 days	0.000092	0.009592	0.009582	0.010614	0.010614	0.010613	0.5
15	30 days	0.000340	0.018433	0.017040	0.018513	0.018513	0.018314	0.0
16	31 days	0.000356	0.018874	0.017805	0.019155	0.019155	0.019021	0.5
17	33 days	0.000650	0.025499	0.022853	0.025108	0.025108	0.025516	0.5
18	34 days	0.000710	0.026647	0.025033	0.027602	0.027602	0.027902	0.0
19	37 days	0.000631	0.025115	0.023830	0.025796	0.025796	0.025430	0.0
20	38 days	0.000679	0.026061	0.025230	0.026997	0.026997	0.026799	0.0
21	40 days	0.000816	0.028557	0.027248	0.029646	0.029646	0.030147	0.0
22	41 days	0.000822	0.028667	0.027415	0.030074	0.030074	0.030378	0.0
23	44 days	0.000877	0.029623	0.028176	0.030375	0.030375	0.029872	0.0
24	45 days	0.000938	0.030624	0.029648	0.031597	0.031597	0.031326	0.5

1.3.5 E. XGBoost Model

1.3.5.1 1. Data Preparation:

It is important to initially mention that I decided to develop an XGBoost model for four different versions of my data.

1. Ungrouped, unscaled data: Essentially, the dataframe created after the initial preprocessing.
2. Grouped, unscaled data: All observations on a specific day are averaged so that Date is a unique identifier, and the features remain the same magnitude as they were observed.
3. Grouped, scaled data: All observations on a specific day are averaged so that Date is a unique identifier, and the features are scaled to be between zero and one.
4. Ungrouped, scaled data: There are multiple observations per Date, and the features are scaled to be between zero and one.

For all of the versions, however, there are a few common preprocessing steps I took. I began by sorting my data by Date and Location to ensure consistency before splitting into train and test sets. I tried creating models with a few different versions of engineered features, and I will include each iteration of my feature engineering and model output process in the appendix; however, for the sake of brevity and clarity, I will include the feature engineering setup I used for my final model I tuned for each data version outlined above. First, I added rolling mean and standard deviation columns to adjust for seasonality and reduce noise (Dancho, 2017). I settled on window = 12 which represents the three-month seasonality pattern I had previously identified. Furthermore, I converted the Date column to a datetime datatype and added additional lag columns for three and nine month lags to account for the three-month pattern. I chose not to impute the missing values of the lag columns as one does not need to for XGBoost I also one-hot-encoded my data to account for the few categorical variables in my dataframe to ensure compatibility with XGBoost. Here is how I did that process for Version 1 of my data:

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct' 

# Converting Date column to datetime
df['Date'] = pd.to_datetime(df['Date'])

# Sorting data by Date and Location
df_v1 = df.sort_values(by=['Date', 'Location'])

# Additional time-series features to account for 3-month pattern
# 3 month lag
df_v1['Additional_Doses_Vax_Pct_3_m_lag'] = df_v1['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v1['Additional_Doses_Vax_Pct_9_m_lag'] = df_v1['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v1['rolling_mean'] = df_v1[pred_var].shift().rolling(window=12).mean()
df_v1['rolling_std'] = df_v1[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_encoded_v1 = pd.get_dummies(df_v1)

Version 1

For the train-test split for Version 1 of my data, I first created a list (splits_by_date) where each element is a DataFrame containing all records from df_encoded corresponding to a unique date. This is done by iterating over each unique date in the Date column. I then initialized a TimeSeriesSplit object from Scikit-learn. TimeSeriesSplit is a cross-validator for time series data, providing train/test indices to split time series data samples. I set it to have 5 splits, with a test size of 12, and a gap of 12. The test_size indicates the number of observations to include in each test set, and gap specifies a gap period between the train and test sets to avoid leakage. I finally created the actual train and test splits by running a loop that iterates over the pairs of train and test indices generated by tscv.split(splits_by_date). For each pair of indices, it concatenates the data frames from splits_by_date corresponding to those indices to create the training and testing sets. This way, I ended up with multiple sets of train and test data, respecting the temporal order of the data. Finally, I dropped the Date column after using it to create the splits as XGBoost can only handle numerical data and the Date attribute is represented in several of the engineered features I created previously. The best model that I created for Version 1 of my data performed quite poorly, so I just used all of the features in my dataframe and did not proceed with feature selection for this data version.

Code

# Split the dataset based on unique dates
splits_by_date_v1 = [df_encoded_v1[df_encoded_v1['Date'] == date] for date in df_encoded_v1['Date'].unique()]

# TimeSeriesSplit
# I made the test_size = 12 because I think three months' worth of data is sufficient

tscv = TimeSeriesSplit(n_splits=3, test_size = 12, gap = 12)

# Loop to create train and test splits
for train_index, test_index in tscv.split(splits_by_date_v1):
    train_v1 = pd.concat([splits_by_date_v1[i] for i in train_index])
    test_v1 = pd.concat([splits_by_date_v1[i] for i in test_index])

# Set up XGBoost data structures
X_train_v1, y_train_v1 = train_v1.drop([pred_var, 'Date'], axis=1), train_v1[pred_var]
X_test_v1, y_test_v1 = test_v1.drop([pred_var, 'Date'], axis=1), test_v1[pred_var]

Version 2

For Version 2, I followed the same specifications as Version 1; however, I dropped the Location column as I am averaging the observations for each Date across all locations. I still did not perform feature selection because the model using these data performed similarly as poorly as Version 1’s did. Also, I am including a line to perform that grouping and the feature engineering after grouping.

Code

# Dropping Location column because we are grouping by Location
df_v2 = df.drop('Location', axis = 1)

# Group by 'Date' to ensure there is one unique value per date
df_v2 = df_v2.groupby('Date').mean(numeric_only=True).reset_index()

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v2['Additional_Doses_Vax_Pct_3_m_lag'] = df_v2['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v2['Additional_Doses_Vax_Pct_9_m_lag'] = df_v2['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v2['rolling_mean'] = df_v2[pred_var].shift().rolling(window=12).mean()
df_v2['rolling_std'] = df_v2[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_v2_encoded = pd.get_dummies(df_v2)

# Split the dataset based on unique dates
splits_by_date_v2 = [df_v2_encoded[df_v2_encoded['Date'] == date] for date in df_v2_encoded['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v2):
    train_v2 = pd.concat([splits_by_date_v2[i] for i in train_index])
    test_v2 = pd.concat([splits_by_date_v2[i] for i in test_index])

# Set up XGBoost data structures and dropping Date column because it cannot be used directly
X_train_v2, y_train_v2 = train_v2.drop([pred_var, 'Date'], axis=1), train_v2[pred_var]
X_test_v2, y_test_v2 = test_v2.drop([pred_var, 'Date'], axis=1), test_v2[pred_var]

Version 3

Version 3 follows the same process as Version 2 with some modifications for scaling. Here, I employed the MinMaxScaler() function to scale the features from 0 to 1. To do this, I had to drop the Date column from the dataframe as it cannot be scaled; however, I added it back to the dataframe after scaling for use in the train-test split. I included feature engineering after grouping and scaling the data. I did not have time to do feature selection here and chose only to do it on Version 4 as it was the version whose model achieved the best results for XGBoost.

Code

# Dropping Location column because we are grouping by Location
df_v3 = df.drop('Location', axis = 1)

# Group by 'Date' to ensure there is one unique value per date
df_v3 = df_v3.groupby('Date').mean(numeric_only=True).reset_index()

# Create a new DataFrame from the aggregated data
data = pd.DataFrame(df_v3)

# Separate the 'Date' column for scaling
date_column = data['Date']
data_without_date = data.drop('Date', axis=1)

# Initialize the MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data without the 'Date' column
scaled_data = min_max_scaler.fit_transform(data_without_date)

# Create a new DataFrame with the scaled data
df_v3 = pd.DataFrame(scaled_data, columns=data_without_date.columns, index=data_without_date.index)

# Add the 'Date' column back to the scaled DataFrame (for train test split)
df_v3['Date'] = date_column

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v3['Additional_Doses_Vax_Pct_3_m_lag'] = df_v3['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v3['Additional_Doses_Vax_Pct_9_m_lag'] = df_v3['Additional_Doses_Vax_Pct'].shift(36)

# Rolling statistics
df_v3['rolling_mean'] = df_v3[pred_var].shift().rolling(window=12).mean()
df_v3['rolling_std'] = df_v3[pred_var].shift().rolling(window=12).std()

# One-hot encoding of the entire dataframe
df_encoded_v3 = pd.get_dummies(df_v3)

# Split the dataset based on unique dates
splits_by_date_v3 = [df_encoded_v3[df_encoded_v3['Date'] == date] for date in df_encoded_v3['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v3):
    train_v3 = pd.concat([splits_by_date_v3[i] for i in train_index])
    test_v3 = pd.concat([splits_by_date_v3[i] for i in test_index])

# Set up XGBoost data structures and dropping Date column because it cannot be used directly
X_train_v3, y_train_v3 = train_v3.drop([pred_var, 'Date'], axis=1), train_v3[pred_var]
X_test_v3, y_test_v3 = test_v3.drop([pred_var, 'Date'], axis=1), test_v3[pred_var]

Version 4

Version 4’s data preparation consists of a combination of 1’s and 3’s in that I scale the data but do not group it. I performed feature selection after tuning my base model which I will explain more in the tuning section. I again had to drop the Date column and re-append after one hot encoding and scaling the data.

Code

# Save the 'Date' column and drop it from the DataFrame
date_column = df['Date']
df.drop('Date', axis=1, inplace=True)

# Apply one-hot encoding to the DataFrame
df_encoded_v4 = pd.get_dummies(df)

# Apply the scaler to the encoded data
df_v4 = pd.DataFrame(min_max_scaler.fit_transform(df_encoded_v4), columns=df_encoded_v4.columns)

# Re-attach the 'Date' column
df_v4['Date'] = date_column

# Reorder the columns to place 'Date' at the start
df_v4 = df_v4[['Date'] + [col for col in df_v4.columns if col != 'Date']]

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_v4['Additional_Doses_Vax_Pct_3_m_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(12)

# 9 month lag
df_v4['Additional_Doses_Vax_Pct_9_m_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(36)

# 1 week lag (because ACF plot said to)
df_v4['Additional_Doses_Vax_Pct_1_w_lag'] = df_v4['Additional_Doses_Vax_Pct'].shift(1)

# Rolling statistics
df_v4['rolling_mean'] = df_v4[pred_var].shift().rolling(window=12).mean()
df_v4['rolling_std'] = df_v4[pred_var].shift().rolling(window=12).std()

# Split the dataset based on unique dates
splits_by_date_v4 = [df_v4[df_v4['Date'] == date] for date in df_v4['Date'].unique()]

# Train test split
for train_index, test_index in tscv.split(splits_by_date_v4):
    train_v4 = pd.concat([splits_by_date_v4[i] for i in train_index])
    test_v4 = pd.concat([splits_by_date_v4[i] for i in test_index])
    
# Set up XGBoost data structures and dropping 'Date' because XGBoost cannot handle it
X_train_v4, y_train_v4 = train_v4.drop([pred_var, 'Date'], axis=1), train_v4[pred_var]
X_test_v4, y_test_v4 = test_v4.drop([pred_var, 'Date'], axis=1), test_v4[pred_var]

1.3.5.2 2. Model Building:

XGBoost, which stands for eXtreme Gradient Boosting, works by iteratively combining a sequence of simple decision trees, each correcting the errors of its predecessors, to form a powerful ensemble model that delivers highly accurate predictions. In the context of predicting vaccine rates, XGBoost stands out for its ability to handle complex, varied datasets with high efficiency and accuracy. It is robust to different data types and missing values and it has powerful boosting capabilities. However, successful application requires thoughtful preprocessing, feature engineering, and hyperparameter optimization to tailor the model to the specific nuances of vaccine data. Furthermore, XGBoost models do not have an inherent understanding of temporal structures of time series data (Brownlee, 2021; Jain, 2023).

XGBoost has a variety of parameters to tune. I will briefly go over some of the key ones I decided to tune and focus on.

subsample controls the proportion of data used to create each tree.

reg_alpha represents the L1 regularization term on weights (Lasso Regression) used to prevent overfitting by penalizing the absolute size of the weights; a larger value specifies stronger regularization, and it can drive some weights to zero.

reg_lambda represents the L2 regularization term on weights (Ridge Regression) used to prevent overfitting by penalizing large weights; a larger value specifies stronger regularization.

n_estimators is the number of gradient boosted trees to be used in the model with a higher number giving potentially more predictive power but also slower run times and overfitting.

min_child_weight specifies the minimum sum of instance weight needed in a leaf to control overfitting. High values help the model avoid learning highly specific relations for a selected tree sample.

max_depth denotes the maximum tree depth with a deeper tree corresponding with more complex, potentially overfit, relationships by allowing for more splits.

learning_rate scales each tree’s contribution. Higher values can cause models to be bad at generalizing whereas smaller values can make models robust but time consuming to train.

gamma controls the minimum loss reduction required to make a further separation on a leaf node with a higher value corresponding with fewer splits.

colsample_bytree represents the proportion of features to be randomly sampled to create each tree. Randomness helps with model robustness and prevents overfitting (xgboost developers, 2022).

As for the training process for XGBoost, I followed the same process for each version; however, I will show how I trained the model for Version 4 below and the training process for the other versions will be in the appendix.

In the Data Preparation section, I showed how I split my data into train and test sets and then into X_train, y_train, X_test, and y_test so that the XGBoost model can train on known data and then validate the model’s predictive accuracy on unseen data to ensure its generalizability and effectiveness.

To train a base XGBoost model, I initiated with the parameters learning_rate = 0.01, n_estimators = 1000, and set early_stopping_rounds = 10. I chose a lower learning rate of 0.01, aiming for gradual weight updates to reduce overfitting risks and enhance robustness. I also selected a high number of estimators at 1000 trees to enable the model to capture complex patterns in the time-series dataset. Lastly, I implemented early stopping to halt training after 10 consecutive rounds without improvement in model performance, thereby preventing overfitting and conserving computational resources.

Code

# Initialize the XGBRegressor with specific parameters
reg_base_v4 = XGBRegressor(n_estimators=1000, learning_rate=0.01, early_stopping_rounds=10)

# Fit the model to the training data
reg_base_v4.fit(X_train_v4, y_train_v4, eval_set=[(X_train_v4, y_train_v4), (X_test_v4, y_test_v4)], verbose = False)

XGBRegressor(base_score=None, booster=None, callbacks=None,
             colsample_bylevel=None, colsample_bynode=None,
             colsample_bytree=None, early_stopping_rounds=10,
             enable_categorical=False, eval_metric=None, feature_types=None,
             gamma=None, gpu_id=None, grow_policy=None, importance_type=None,
             interaction_constraints=None, learning_rate=0.01, max_bin=None,
             max_cat_threshold=None, max_cat_to_onehot=None,
             max_delta_step=None, max_depth=None, max_leaves=None,
             min_child_weight=None, missing=nan, monotone_constraints=None,
             n_estimators=1000, n_jobs=None, num_parallel_tree=None,
             predictor=None, random_state=None, ...)

In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

I then plotted the results of my model and the train and test RMSEs to evaluate the performance of my model and indicate whether I should continue training it.

Code

# Forecasting and Evaluation
train_pred_base_v4 = reg_base_v4.predict(X_train_v4)
test_pred_base_v4 = reg_base_v4.predict(X_test_v4)

# Plotting
fig, ax = plt.subplots(2, 1, figsize=(20, 10))

# Train plot
ax[0].plot(train_v4.index, y_train_v4, label='Actual')
ax[0].plot(train_v4.index, train_pred_base_v4, label='Predicted')
ax[0].set_title('Train Data')
ax[0].legend()

# Test plot
ax[1].plot(test_v4.index, y_test_v4, label='Actual')
ax[1].plot(test_v4.index, test_pred_base_v4, label='Predicted')
ax[1].set_title('Test Data')
ax[1].legend()

# Show the plots
plt.show()

# Print RMSE values
train_rmse_base_v4 = np.sqrt(mean_squared_error(y_train_v4, train_pred_base_v4))
test_rmse_base_v4 = np.sqrt(mean_squared_error(y_test_v4, test_pred_base_v4))
print(f"Train RMSE of base model {train_rmse_base_v4}")
print(f"Test RMSE of base model {test_rmse_base_v4}")

Train RMSE of base model 0.0013047871873905932
Test RMSE of base model 0.090238365990643

These results are good compared to the initial data versions I used. However, I attempt to improve them with feature selection. I did this by extracting feature importances from the previous base XGBoost model, reg_base_v4, by selecting features exceeding the average importance. I then retrained a new model with these selected features, evaluated its performance using RMSE, and printed the number, names of the selected features, and parameters of the retrained model, selected_model_base (Pedregosa et al., 2011).

Code

# 1. Extract feature importances
importances = reg_base_v4.feature_importances_

# 2. Determine a threshold
threshold = np.mean(importances)

# 3. Select features based on threshold
selection = SelectFromModel(reg_base_v4, threshold=threshold, prefit=True)
X_train_selected_v4 = selection.transform(X_train_v4)
X_test_selected_v4 = selection.transform(X_test_v4)

4. # Retrain model with selected features
selected_model_base = xgb.XGBRegressor(learning_rate=0.01, n_estimators=1000, early_stopping_rounds=10)
selected_model_base.fit(X_train_selected_v4, y_train_v4, eval_set=[(X_train_selected_v4, y_train_v4), (X_test_selected_v4, y_test_v4)], verbose=False)

# 5. Evaluate the retrained model
train_pred_selected = selected_model_base.predict(X_train_selected_v4)
test_pred_selected = selected_model_base.predict(X_test_selected_v4)

# Calculate RMSE for the retrained model
train_rmse_selected = np.sqrt(mean_squared_error(y_train_v4, train_pred_selected))
test_rmse_selected = np.sqrt(mean_squared_error(y_test_v4, test_pred_selected))
print(f"Train RMSE with selected features: {train_rmse_selected}")
print(f"Test RMSE with selected features: {test_rmse_selected}")

# Print the number and names of selected features
selected_features = np.array(X_train_v4.columns)[selection.get_support()]
print(f"Number of selected features: {len(selected_features)}")
print("Selected features:", selected_features)

# Print the parameters used in the selected_model_base
params_selected_model_base = selected_model_base.get_params()
print("Parameters used in the model:\n", params_selected_model_base)

Train RMSE with selected features: 0.0012672636322900329
Test RMSE with selected features: 0.08596906481390161
Number of selected features: 12
Selected features: ['Distributed' 'Distributed_Janssen' 'Distributed_Per_100k_65Plus'
 'Administered' 'Administered_Janssen' 'Administered_Pfizer'
 'Administered_Dose1_Recip_65PlusPop_Pct' 'Series_Complete_Janssen'
 'Series_Complete_Unk_Manuf' 'Series_Complete_Unk_Manuf_12Plus'
 'Additional_Doses_18Plus_Vax_Pct' 'Additional_Doses_65Plus_Vax_Pct']
Parameters used in the model:
 {'objective': 'reg:squarederror', 'base_score': None, 'booster': None, 'callbacks': None, 'colsample_bylevel': None, 'colsample_bynode': None, 'colsample_bytree': None, 'early_stopping_rounds': 10, 'enable_categorical': False, 'eval_metric': None, 'feature_types': None, 'gamma': None, 'gpu_id': None, 'grow_policy': None, 'importance_type': None, 'interaction_constraints': None, 'learning_rate': 0.01, 'max_bin': None, 'max_cat_threshold': None, 'max_cat_to_onehot': None, 'max_delta_step': None, 'max_depth': None, 'max_leaves': None, 'min_child_weight': None, 'missing': nan, 'monotone_constraints': None, 'n_estimators': 1000, 'n_jobs': None, 'num_parallel_tree': None, 'predictor': None, 'random_state': None, 'reg_alpha': None, 'reg_lambda': None, 'sampling_method': None, 'scale_pos_weight': None, 'subsample': None, 'tree_method': None, 'validate_parameters': None, 'verbosity': None}

The results showed improvement, but to further enhance the model, I initiated hyperparameter tuning using RandomizedSearchCV for a coarse grid search, which efficiently identifies the general range of optimal hyperparameters with minimal computing resources. RandomizedSearchCV randomly selects and evaluates a specified number of combinations from a given hyperparameter space, using cross-validation to identify the best performing model configuration efficiently. I used cv = tscv to ensure I am cross validating while respecting the temporal nature of the data as TimeSeriesSplit provides train/test indices to split the time series data samples into such a way (Pedregosa et al., 2011).

Code

# Define the hyperparameter space
param_dist_v4 = {
    'learning_rate': [0.001, 0.01, 0.05, 0.1, 0.2, 0.3],
    'n_estimators': [25, 50, 100, 150, 200, 250, 300, 400, 500, 1000],
    'max_depth': np.arange(3, 10, 1),
    'min_child_weight': np.arange(1, 6, 1),
    'gamma': np.linspace(0, 0.5, 5),
    'subsample': np.linspace(0.5, 1, 5),
    'colsample_bytree': np.linspace(0.5, 1, 5),
    'reg_alpha': np.logspace(-5, 1, 5),
    'reg_lambda': np.logspace(-5, 1, 5)
}

# Initialize XGBoost regressor
xgb_reg_v4 = XGBRegressor(n_estimators=1000)

# Initialize RandomizedSearchCV
random_search_v4 = RandomizedSearchCV(
    estimator=xgb_reg_v4, 
    param_distributions=param_dist_v4, 
    n_iter=100, 
    scoring='neg_mean_squared_error', 
    cv=tscv, 
    verbose=1, 
    n_jobs=-1, 
    random_state=42
)

# Perform the tuning
random_search_v4.fit(X_train_selected_v4, y_train_v4)
 
# Evaluate the best model
best_model_fs_v4 = random_search_v4.best_estimator_
train_pred_fs_v4 = best_model_fs_v4.predict(X_train_selected_v4)
test_pred_fs_v4 = best_model_fs_v4.predict(X_test_selected_v4)

# Calculate RMSE for the best model
train_rmse_fs_v4 = sqrt(mean_squared_error(y_train_v4, train_pred_fs_v4))
test_rmse_fs_v4 = sqrt(mean_squared_error(y_test_v4, test_pred_fs_v4))

# Print the best parameters and RMSE values
print("Best parameters:", random_search_v4.best_params_)
print(f"Train RMSE: {train_rmse_fs_v4}")
print(f"Test RMSE: {test_rmse_fs_v4}")

Fitting 3 folds for each of 100 candidates, totalling 300 fits

/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):
/Users/avaserin/anaconda3/lib/python3.11/site-packages/xgboost/data.py:427: FutureWarning: is_sparse is deprecated and will be removed in a future version. Check `isinstance(dtype, pd.SparseDtype)` instead.
  if is_sparse(data):

Best parameters: {'subsample': 0.75, 'reg_lambda': 0.31622776601683794, 'reg_alpha': 0.01, 'n_estimators': 400, 'min_child_weight': 1, 'max_depth': 5, 'learning_rate': 0.2, 'gamma': 0.0, 'colsample_bytree': 0.625}
Train RMSE: 0.0011601848782626465
Test RMSE: 0.1025870952741192

Despite searching through other parameters using RandomizedSearchCV, I could not achieve a test RMSE lower than that of the base model with feature selection. Although I wanted to do a GridSearchCV, Professor Shi said not to focus on tuning, and it is very computationally expensive to perform one. Therefore, I proceeded with the parameters found in the feature selected base model.

During this phase, I encountered several challenges: My laptop’s limited memory meant that both RandomizedSearchCV and GridSearchCV were computationally intensive, sometimes taking over 24 hours to complete. Additionally, developing and tuning models for all of the data versions I previously mentioned was time-consuming and often unproductive. Surprisingly, in some cases, my initial base model outperformed the grid-searched models, even though the grid included the base model’s parameters. Finally, I suspect overfitting was a primary issue, likely due to the cumulative nature of my data and the small size of my dataframe.

1.3.5.3 3. Model Performance

I am confident I created and tuned the XGBoost model with among the lowest RMSEs possible given my small dataframe and issues with cumulative predictions. Despite this, compared to other models, the RMSE is relatively high. Furthermore, the visualizations make clear that there is evidence of overfitting in my models. Some of the most important features in this model include the percent of people 18+ who completed a primary series and have received a booster (or additional) doses (Additional_Doses_18Plus_Vax_Pct), total number of doses delivered per 100,000 people ages 65+ (Distributed_Per_100k_65Plus), and total number of doses delivered from other manufacturers (Series_Complete_Unk_Manuf). This indicates that looking at specific age groups’ vaccination rates can help to inform overall vaccination rates and that unpopular vaccine manufacturers might have a large impact.

Code

# Evaluate the retrained model
train_pred_selected = selected_model_base.predict(X_train_selected_v4)
test_pred_selected = selected_model_base.predict(X_test_selected_v4)

# Calculate RMSE for the retrained model
train_rmse_selected = np.sqrt(mean_squared_error(y_train_v4, train_pred_selected))
test_rmse_selected = np.sqrt(mean_squared_error(y_test_v4, test_pred_selected))
print(f"Train RMSE with selected features: {train_rmse_selected}")
print(f"Test RMSE with selected features: {test_rmse_selected}")

# Visualizing Predicted vs Actual Values for Train and Test Sets
fig, ax = plt.subplots(2, 1, figsize=(12, 10))

# Train Data
ax[0].plot(train_v4['Date'], y_train_v4, label='Actual', color='blue')
ax[0].plot(train_v4['Date'], train_pred_selected, label='Predicted', color='red')
ax[0].set_title('Train Data: Actual vs Predicted')
ax[0].legend()
ax[0].set_xlabel('Date')
ax[0].set_ylabel(pred_var)

# Test Data
ax[1].plot(test_v4['Date'], y_test_v4, label='Actual', color='blue')
ax[1].plot(test_v4['Date'], test_pred_selected, label='Predicted', color='red')
ax[1].set_title('Test Data: Actual vs Predicted')
ax[1].legend()
ax[1].set_xlabel('Date')
ax[1].set_ylabel(pred_var)

plt.tight_layout()
plt.show()
# Extract the names of the selected features
selected_feature_names = np.array(X_train_v4.columns)[selection.get_support()]

# Set the feature names in the XGBoost model
selected_model_base.get_booster().feature_names = selected_feature_names.tolist()
# Display Top 5 Important Features
plt.figure(figsize=(10, 6))
plot_importance(selected_model_base, max_num_features=5)
plt.title('Top 5 Important Features')
plt.show()

Train RMSE with selected features: 0.0012672636322900329
Test RMSE with selected features: 0.08596906481390161

<Figure size 1000x600 with 0 Axes>

Code

# Initialize a list to store RMSEs for each fold
cv_rmses = []

# Perform TimeSeriesSplit
for train_index, test_index in tscv.split(splits_by_date_v4):
    train = pd.concat([splits_by_date_v4[i] for i in train_index])
    test = pd.concat([splits_by_date_v4[i] for i in test_index])
    
    X_train, y_train = train.drop([pred_var, 'Date'], axis=1), train[pred_var]
    X_test, y_test = test.drop([pred_var, 'Date'], axis=1), test[pred_var]

    # Feature selection and model fitting as before
    reg_base = XGBRegressor(n_estimators=1000, learning_rate=0.01, early_stopping_rounds=10)
    reg_base.fit(X_train, y_train, eval_set=[(X_train, y_train), (X_test, y_test)], verbose=False)
    selection = SelectFromModel(reg_base, threshold='mean', prefit=True)
    X_train_selected = selection.transform(X_train)
    X_test_selected = selection.transform(X_test)

    selected_model = xgb.XGBRegressor(learning_rate=0.01, n_estimators=1000, early_stopping_rounds=10)
    selected_model.fit(X_train_selected, y_train, eval_set=[(X_train_selected, y_train), (X_test_selected, y_test)], verbose=False)

    # Make predictions and calculate RMSE
    test_pred = selected_model.predict(X_test_selected)
    rmse = np.sqrt(mean_squared_error(y_test, test_pred))
    cv_rmses.append(rmse)

# Calculate the average cross-validated RMSE
cv_rmse = np.mean(cv_rmses)
print(f"Cross-validated RMSE: {cv_rmse}")

Cross-validated RMSE: 0.06388431417642502

1.3.6 F. Long Short-Term Memory (LSTM) Model

1.3.6.1 1. Data Preparation:

For the LSTM model, I created many different initial variations with different data preparations. For instance, I tried some models where I imputed NaN values with zeroes or normalized instead of scaling my data. I will include these versions in the appendix. Below is the data preparation I did for my most successful model.

I began by importing the cleaned data, converting the Date column to a datetime datatype and sorting it by Date and Location to ensure the train-test split is done correctly and without data leakage. I one-hot-encoded the categorical variables as LSTM models inherently work with numerical data, and categorical data are not interpretable by them (Pramoditha, 2022). I then set Date and Location as a multi-index to form a combined, two-level index for each row. This helps to preserve the temporal and spatial context of the dataset to accurately model time series data that varies over time and across different locations. I added the lag and rolling mean and standard deviation models I have added to all of the other models I have developed for the same reasons. There were many NaN values in these columns because of the nature of how lag columns are developed. Finally, I scaled the data to fall within a range from 0 to 1 using MinMaxScaler as LSTM models, like many neural network architectures, are sensitive to the scale of input data. Scaling can optimize gradient descent efficiency and help the data conform to activation function dynamics (Hedengren, 2022).

Next, to create sequences from the scale as inputs to the LSTM model, I created a function make_series so that the model can capture temporal dependencies (Aggarwal, 2023). I wanted to create a sequence for each location to capture any differences in the data across locations, so I grouped using groupby(level = 'Location') before constructing the sequences of length 12 corresponding to a segment of continuous observations. I chose this length to capture the relevant three-month temporal patterns in the data. The target variable, target, for each sequence is pred_var at the end of the sequence. Furthermore, I decided to use all of the features in my model as

The generated sequences, data_series are then split into training and testing sets with the test_size parameter determining the number of sequences included in the test set. I then split data_series into train and test series with the test series being size 1080 as it represents approximately 20% of the data and is a multiple of 12 (the sequence length I used). Finally, the sequences are converted into arrays with X_train and X_test containing the input features (excluding the target variable), and y_train and y_test containing the corresponding target values. Instead of feature selection, I performed feature extraction for this model by employing principal component analysis (PCA) to reduce dimensionality to reduce model complexity. Despite this, I achieved far worse results by way of RMSE. The code I used a results from PCA can be found in the LSTM Feature Extraction section of the appendix.

Finally, I initialized TimeSeriesSplit for cross-validation throughout the model training process to ensure that validation sets are always later in time than the training sets. This respect of temporal order of observations is crucial for time series models such as LSTMs, and it was important for me to cross-validate as I trained my models to mitigate overfitting concerns.

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location'
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Additional time-series columns to account for 3-month pattern
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

# Forward fill missing values
df_encoded.fillna(method='ffill', inplace=True)
df_encoded.fillna(method='bfill', inplace=True)

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Apply the scaler to the data
df_scaled = pd.DataFrame(min_max_scaler.fit_transform(df_encoded), columns=df_encoded.columns, index=df_encoded.index)

# Function to create sequences for LSTM
def make_series(data, sequence_length, pred_var):
    series = []
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i - sequence_length:i]
            target = group.iloc[i][pred_var]
            series.append((sequence.index[0], target, sequence.drop(pred_var, axis=1).values))
    return series

# Set sequence length
sequence_length = 12

# Create sequences from the scaled data
data_series = make_series(df_scaled, sequence_length, pred_var)

# Split into train and test sequences
test_size = 1080  # Size of test set
train_series = data_series[:-test_size]
test_series = data_series[-test_size:]

# Prepare data for LSTM
X_train = np.array([x[2] for x in train_series])
y_train = np.array([x[1] for x in train_series])
X_test = np.array([x[2] for x in test_series])
y_test = np.array([x[1] for x in test_series])

# Initialize TimeSeriesSplit
tscv = TimeSeriesSplit(n_splits=5)

1.3.6.2 2. Model Building:

There are many parameters in the LSTM model one can modify to help tune the model. I will go over a few below:

Number of Neurons (neurons_options): In the LSTM layer, units specify the dimensionality of the output space, or the number of neurons in the layer. This parameter determines the model’s ability to learn complex patterns at the risk of overfitting.

Return Sequences (return_sequences): Determines if the layer should return the full sequence (True) or only the last output (False).

Optimizer (optimizer): In the model’s compile method, the optimizer parameter is set, often to ‘adam’ for LSTM models. It’s defined as optimizer='adam'. Adam modifies the learning rate throughout model training.

Loss Function (loss): This computes the quantity that a model should seek to minimize during training, for example Mean Absolute Error (MAE).

Dropout (dropout_options): Dropout is the proportion of the neurons in the layer to be omitted during training and is a regularization technique to prevent overfitting.

Regularization Coefficients (l1_reg_options and l2_reg_options): These are the options for Lasso and Ridge regularization coefficients, respectively used to prevent overfitting.

Batch Size (batch_sizes): Specifies the size of the batch of training data used in each iteration of the model’s training process, influencing the speed and stability of the network’s convergence.

Activation Function (activation): The activation function is a mathematical operation applied to a node’s output, transforming the input signal into an output signal and introducing non-linearity into the model (Chollet, n.d.; Chowdhury, 2021).

As for the training process, in the following code chunk I implement a cross-validation process to train the model followed by training a final model on the full training dataset. I did this by iterating over training and validation splits produced by TimeSeriesSplitand splitting the training data into training and validation sets for the current fold using indices. I then define the LSTM model with an input layer (Input), an LSTM layer (LSTM), a dropout layer (Dropout), and an output layer (Dense). The model is compiled with the Adam optimizer and MAE loss function, trained on the current training fold, and then validated on the respective subset. I decided to use epochs=100 and batch_size=32 because such a relatively high number of epochs allows it to train for an extended period and a batch size of 32 balances computational efficiency and model convergence. After this cross-validation is performed, the final model is defined with the same architecture and trained in the same way on the entire training dataset without validation data to optimize the model’s performance.

Code

# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define LSTM model
    inputs = Input(shape=(sequence_length, X_train_fold.shape[2]))
    lstm_out = LSTM(32, return_sequences=False)(inputs)
    lstm_out = Dropout(0.2)(lstm_out)
    outputs = Dense(1)(lstm_out)
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=32,
              validation_data=(X_val_fold, y_val_fold), shuffle=False)

# Final Model Training on Full Train Data
model_final = Model(inputs=inputs, outputs=outputs)
model_final.compile(optimizer='adam', loss='mae')
model_final.fit(X_train, y_train, epochs=100, batch_size=32, shuffle=False)

Epoch 1/100

2023-11-27 18:06:08.296705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:08.297316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:08.297649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:08.334288: W tensorflow/tsl/platform/profile_utils/cpu_utils.cc:128] Failed to get CPU frequency: 0 Hz
2023-11-27 18:06:08.417402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:08.417871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:08.418303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:08.581520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:08.581962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:08.582372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 12ms/step - loss: 0.2970 - val_loss: 0.1270
Epoch 2/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1861 - val_loss: 0.1461
Epoch 3/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1639 - val_loss: 0.1063
Epoch 4/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1483

2023-11-27 18:06:08.978867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:08.979483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:08.979881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 3ms/step - loss: 0.1461 - val_loss: 0.0891
Epoch 5/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1197 - val_loss: 0.0970
Epoch 6/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1126 - val_loss: 0.1142
Epoch 7/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1259 - val_loss: 0.0882
Epoch 8/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0911 - val_loss: 0.0832
Epoch 9/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0930 - val_loss: 0.0874
Epoch 10/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0845
Epoch 11/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0945
Epoch 12/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0851 - val_loss: 0.1279
Epoch 13/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0866 - val_loss: 0.1404
Epoch 14/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.1061
Epoch 15/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0897
Epoch 16/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0822 - val_loss: 0.0895
Epoch 17/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0942 - val_loss: 0.0993
Epoch 18/100
18/18 [==============================] - 0s 3ms/step - loss: 0.1019 - val_loss: 0.1418
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0934 - val_loss: 0.0862
Epoch 20/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0744 - val_loss: 0.0844
Epoch 21/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.1118
Epoch 22/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0860
Epoch 23/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0817
Epoch 24/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0792
Epoch 25/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0863
Epoch 26/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0883
Epoch 27/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0785
Epoch 28/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0697
Epoch 29/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0760
Epoch 30/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0814
Epoch 31/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0708
Epoch 32/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0862
Epoch 33/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0746
Epoch 34/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0922
Epoch 35/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0920 - val_loss: 0.0924
Epoch 36/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0647
Epoch 37/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0663
Epoch 38/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0676
Epoch 39/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0720
Epoch 40/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0683
Epoch 41/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0713
Epoch 42/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0856
Epoch 43/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0777
Epoch 44/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0668
Epoch 45/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0644
Epoch 46/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0673
Epoch 47/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0669
Epoch 48/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0690
Epoch 49/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0839
Epoch 50/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0697
Epoch 51/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0588
Epoch 52/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0577
Epoch 53/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0677
Epoch 54/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0731
Epoch 55/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0853
Epoch 56/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.1002
Epoch 57/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0842
Epoch 58/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0817
Epoch 59/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0684
Epoch 60/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0700
Epoch 61/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0696
Epoch 62/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0714
Epoch 63/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0858
Epoch 64/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0672
Epoch 65/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0605
Epoch 66/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0652
Epoch 67/100
18/18 [==============================] - 0s 2ms/step - loss: 0.0569 - val_loss: 0.0998
Epoch 68/100
18/18 [==============================] - 0s 2ms/step - loss: 0.0586 - val_loss: 0.1055
Epoch 69/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0669
Epoch 70/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0648
Epoch 71/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0618
Epoch 72/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0620
Epoch 73/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0599
Epoch 74/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0593
Epoch 75/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0618
Epoch 76/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0593
Epoch 77/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0553
Epoch 78/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0530
Epoch 79/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0718
Epoch 80/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0821
Epoch 81/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0756
Epoch 82/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0920
Epoch 83/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0674
Epoch 84/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0584
Epoch 85/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0585
Epoch 86/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0545
Epoch 87/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0613
Epoch 88/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0515
Epoch 89/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0552
Epoch 90/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0659
Epoch 91/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0916
Epoch 92/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.1055
Epoch 93/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0626
Epoch 94/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0617
Epoch 95/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0636
Epoch 96/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0594
Epoch 97/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0552
Epoch 98/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0604
Epoch 99/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0618
Epoch 100/100
18/18 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0714
Epoch 1/100

2023-11-27 18:06:14.314409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:14.314861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:14.315437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:14.403544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:14.404677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:14.405221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

 1/34 [..............................] - ETA: 13s - loss: 0.1294

2023-11-27 18:06:14.547908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:14.548527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:14.549009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 6ms/step - loss: 0.1937 - val_loss: 0.0689
Epoch 2/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1541 - val_loss: 0.1822
Epoch 3/100
34/34 [==============================] - ETA: 0s - loss: 0.1190

2023-11-27 18:06:14.862363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:14.862842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:14.863504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 2ms/step - loss: 0.1190 - val_loss: 0.1418
Epoch 4/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1086 - val_loss: 0.1002
Epoch 5/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0979 - val_loss: 0.1028
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0929 - val_loss: 0.1012
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1033 - val_loss: 0.1529
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0894 - val_loss: 0.1373
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0732 - val_loss: 0.0937
Epoch 10/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0722 - val_loss: 0.0866
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0705 - val_loss: 0.0697
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0727 - val_loss: 0.0624
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0667 - val_loss: 0.0870
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0696 - val_loss: 0.0500
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0731 - val_loss: 0.0676
Epoch 16/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0682 - val_loss: 0.0682
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0628 - val_loss: 0.0617
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0611 - val_loss: 0.0775
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0640 - val_loss: 0.0651
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0635 - val_loss: 0.0796
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0604 - val_loss: 0.0757
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0610 - val_loss: 0.0749
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0599 - val_loss: 0.0909
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0564 - val_loss: 0.0789
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0555 - val_loss: 0.0873
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0583 - val_loss: 0.0680
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0523 - val_loss: 0.0672
Epoch 28/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0534 - val_loss: 0.0715
Epoch 29/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0554 - val_loss: 0.0756
Epoch 30/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0533 - val_loss: 0.0801
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0540 - val_loss: 0.0704
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0490 - val_loss: 0.0802
Epoch 33/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0521 - val_loss: 0.0771
Epoch 34/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0553 - val_loss: 0.0594
Epoch 35/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0550 - val_loss: 0.0552
Epoch 36/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0615 - val_loss: 0.0460
Epoch 37/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0607 - val_loss: 0.0600
Epoch 38/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0539 - val_loss: 0.0519
Epoch 39/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0548 - val_loss: 0.0602
Epoch 40/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0485 - val_loss: 0.0602
Epoch 41/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0480 - val_loss: 0.0526
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0621
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0630
Epoch 44/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0473 - val_loss: 0.0645
Epoch 45/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0473 - val_loss: 0.0479
Epoch 46/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0450 - val_loss: 0.0606
Epoch 47/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0441 - val_loss: 0.0689
Epoch 48/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0458 - val_loss: 0.0526
Epoch 49/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0441 - val_loss: 0.0747
Epoch 50/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0442 - val_loss: 0.0741
Epoch 51/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0447 - val_loss: 0.0527
Epoch 52/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0425 - val_loss: 0.0470
Epoch 53/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0411 - val_loss: 0.0473
Epoch 54/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0422 - val_loss: 0.0604
Epoch 55/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0429 - val_loss: 0.0714
Epoch 56/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0416 - val_loss: 0.0719
Epoch 57/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0442 - val_loss: 0.0643
Epoch 58/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0410 - val_loss: 0.0609
Epoch 59/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0433 - val_loss: 0.0686
Epoch 60/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0415 - val_loss: 0.0645
Epoch 61/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0456 - val_loss: 0.0443
Epoch 62/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0605
Epoch 63/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0550
Epoch 64/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0499 - val_loss: 0.0591
Epoch 65/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0436 - val_loss: 0.0525
Epoch 66/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0423 - val_loss: 0.0523
Epoch 67/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0376 - val_loss: 0.0589
Epoch 68/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0372 - val_loss: 0.0624
Epoch 69/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0386 - val_loss: 0.0507
Epoch 70/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0423 - val_loss: 0.0641
Epoch 71/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0386 - val_loss: 0.0704
Epoch 72/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0424 - val_loss: 0.0778
Epoch 73/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0436 - val_loss: 0.0598
Epoch 74/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0426 - val_loss: 0.0838
Epoch 75/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0404 - val_loss: 0.0930
Epoch 76/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0381 - val_loss: 0.0736
Epoch 77/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0378 - val_loss: 0.0811
Epoch 78/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0425 - val_loss: 0.0462
Epoch 79/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0553
Epoch 80/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0386 - val_loss: 0.0512
Epoch 81/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0372 - val_loss: 0.0612
Epoch 82/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0340 - val_loss: 0.0518
Epoch 83/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0354 - val_loss: 0.0553
Epoch 84/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0343 - val_loss: 0.0596
Epoch 85/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0341 - val_loss: 0.0631
Epoch 86/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0350 - val_loss: 0.0584
Epoch 87/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0360 - val_loss: 0.0610
Epoch 88/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0345 - val_loss: 0.0474
Epoch 89/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0332 - val_loss: 0.0617
Epoch 90/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0331 - val_loss: 0.0524
Epoch 91/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0330 - val_loss: 0.0558
Epoch 92/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0332 - val_loss: 0.0573
Epoch 93/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0310 - val_loss: 0.0698
Epoch 94/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0299 - val_loss: 0.0607
Epoch 95/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0301 - val_loss: 0.0700
Epoch 96/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0305 - val_loss: 0.0647
Epoch 97/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0307 - val_loss: 0.0500
Epoch 98/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0338 - val_loss: 0.0651
Epoch 99/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0314 - val_loss: 0.0670
Epoch 100/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0316 - val_loss: 0.0535
Epoch 1/100

2023-11-27 18:06:21.869387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:21.869911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:21.870385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:21.960564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:21.961267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:21.961692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:22.126885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:22.127920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:22.128433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 5ms/step - loss: 0.1994 - val_loss: 0.0882
Epoch 2/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1688 - val_loss: 0.0906
Epoch 3/100
 1/51 [..............................] - ETA: 0s - loss: 0.1374

2023-11-27 18:06:22.553890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:22.554318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:22.555007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 2ms/step - loss: 0.1392 - val_loss: 0.0845
Epoch 4/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1258 - val_loss: 0.0794
Epoch 5/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1177 - val_loss: 0.0751
Epoch 6/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1108 - val_loss: 0.0741
Epoch 7/100
51/51 [==============================] - 0s 2ms/step - loss: 0.1074 - val_loss: 0.0693
Epoch 8/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0998 - val_loss: 0.0663
Epoch 9/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0985 - val_loss: 0.0670
Epoch 10/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0993 - val_loss: 0.0647
Epoch 11/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0935 - val_loss: 0.0592
Epoch 12/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0760 - val_loss: 0.0622
Epoch 13/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0757 - val_loss: 0.0781
Epoch 14/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0728 - val_loss: 0.0749
Epoch 15/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0744 - val_loss: 0.0659
Epoch 16/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0755 - val_loss: 0.0644
Epoch 17/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0853 - val_loss: 0.0586
Epoch 18/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0833 - val_loss: 0.0573
Epoch 19/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0783 - val_loss: 0.0498
Epoch 20/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0659 - val_loss: 0.0564
Epoch 21/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0642 - val_loss: 0.0593
Epoch 22/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0654 - val_loss: 0.0615
Epoch 23/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0694 - val_loss: 0.0601
Epoch 24/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0643 - val_loss: 0.0579
Epoch 25/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0726 - val_loss: 0.0533
Epoch 26/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0704 - val_loss: 0.0513
Epoch 27/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0664 - val_loss: 0.0509
Epoch 28/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0642 - val_loss: 0.0462
Epoch 29/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0626 - val_loss: 0.0475
Epoch 30/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0601 - val_loss: 0.0512
Epoch 31/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0571 - val_loss: 0.0481
Epoch 32/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0612 - val_loss: 0.0452
Epoch 33/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0587 - val_loss: 0.0476
Epoch 34/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0597 - val_loss: 0.0493
Epoch 35/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0640 - val_loss: 0.0467
Epoch 36/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0599 - val_loss: 0.0451
Epoch 37/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0566 - val_loss: 0.0455
Epoch 38/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0580 - val_loss: 0.0450
Epoch 39/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0577 - val_loss: 0.0449
Epoch 40/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0560 - val_loss: 0.0423
Epoch 41/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0549 - val_loss: 0.0447
Epoch 42/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0555 - val_loss: 0.0432
Epoch 43/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0517 - val_loss: 0.0438
Epoch 44/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0479 - val_loss: 0.0455
Epoch 45/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0491 - val_loss: 0.0448
Epoch 46/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0509 - val_loss: 0.0422
Epoch 47/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0498 - val_loss: 0.0405
Epoch 48/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0519 - val_loss: 0.0469
Epoch 49/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0552 - val_loss: 0.0452
Epoch 50/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0582 - val_loss: 0.0422
Epoch 51/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0541 - val_loss: 0.0413
Epoch 52/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0494 - val_loss: 0.0412
Epoch 53/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0466 - val_loss: 0.0455
Epoch 54/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0458 - val_loss: 0.0423
Epoch 55/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0470 - val_loss: 0.0473
Epoch 56/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0482 - val_loss: 0.0425
Epoch 57/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0505 - val_loss: 0.0423
Epoch 58/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0489 - val_loss: 0.0406
Epoch 59/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0448 - val_loss: 0.0404
Epoch 60/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0440 - val_loss: 0.0409
Epoch 61/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0423 - val_loss: 0.0417
Epoch 62/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0459 - val_loss: 0.0413
Epoch 63/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0474 - val_loss: 0.0381
Epoch 64/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0439 - val_loss: 0.0399
Epoch 65/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0429 - val_loss: 0.0409
Epoch 66/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0434 - val_loss: 0.0400
Epoch 67/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0451 - val_loss: 0.0421
Epoch 68/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0419 - val_loss: 0.0392
Epoch 69/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0425 - val_loss: 0.0407
Epoch 70/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0409 - val_loss: 0.0382
Epoch 71/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0452 - val_loss: 0.0399
Epoch 72/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0408 - val_loss: 0.0375
Epoch 73/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0418 - val_loss: 0.0382
Epoch 74/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0408 - val_loss: 0.0376
Epoch 75/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0378 - val_loss: 0.0390
Epoch 76/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0391 - val_loss: 0.0383
Epoch 77/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0377 - val_loss: 0.0417
Epoch 78/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0378 - val_loss: 0.0419
Epoch 79/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0376 - val_loss: 0.0403
Epoch 80/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0399
Epoch 81/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0410 - val_loss: 0.0378
Epoch 82/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0393 - val_loss: 0.0369
Epoch 83/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0390 - val_loss: 0.0382
Epoch 84/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0372 - val_loss: 0.0372
Epoch 85/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0349
Epoch 86/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0344
Epoch 87/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0367 - val_loss: 0.0354
Epoch 88/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0360 - val_loss: 0.0362
Epoch 89/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0337 - val_loss: 0.0361
Epoch 90/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0366 - val_loss: 0.0363
Epoch 91/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0348 - val_loss: 0.0344
Epoch 92/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0350 - val_loss: 0.0334
Epoch 93/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0343 - val_loss: 0.0327
Epoch 94/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0361 - val_loss: 0.0368
Epoch 95/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0330
Epoch 96/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0355 - val_loss: 0.0308
Epoch 97/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0347 - val_loss: 0.0356
Epoch 98/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0341 - val_loss: 0.0311
Epoch 99/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0310 - val_loss: 0.0328
Epoch 100/100
51/51 [==============================] - 0s 2ms/step - loss: 0.0321 - val_loss: 0.0327
Epoch 1/100

2023-11-27 18:06:33.299321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:33.299833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:33.300352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:33.381795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:33.382269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:33.382674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:33.535147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:33.535617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:33.536109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 4ms/step - loss: 0.2193 - val_loss: 0.1747
Epoch 2/100
51/68 [=====================>........] - ETA: 0s - loss: 0.1751

2023-11-27 18:06:34.005173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:34.005659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:34.006247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 2ms/step - loss: 0.1660 - val_loss: 0.1852
Epoch 3/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1318 - val_loss: 0.1882
Epoch 4/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1229 - val_loss: 0.1317
Epoch 5/100
68/68 [==============================] - 0s 2ms/step - loss: 0.1099 - val_loss: 0.1261
Epoch 6/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0949 - val_loss: 0.1468
Epoch 7/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0888 - val_loss: 0.1166
Epoch 8/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0870 - val_loss: 0.1518
Epoch 9/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0819 - val_loss: 0.1218
Epoch 10/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0824 - val_loss: 0.1149
Epoch 11/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0759 - val_loss: 0.1227
Epoch 12/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0738 - val_loss: 0.1079
Epoch 13/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0734 - val_loss: 0.1147
Epoch 14/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0767 - val_loss: 0.1274
Epoch 15/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0745 - val_loss: 0.1092
Epoch 16/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0668 - val_loss: 0.1003
Epoch 17/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0670 - val_loss: 0.1297
Epoch 18/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0729 - val_loss: 0.1116
Epoch 19/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0723 - val_loss: 0.1054
Epoch 20/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0735 - val_loss: 0.1025
Epoch 21/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0681 - val_loss: 0.0802
Epoch 22/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0658 - val_loss: 0.0994
Epoch 23/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0634 - val_loss: 0.0815
Epoch 24/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0614 - val_loss: 0.0893
Epoch 25/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0618 - val_loss: 0.0852
Epoch 26/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0572 - val_loss: 0.0861
Epoch 27/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0574 - val_loss: 0.0991
Epoch 28/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0611 - val_loss: 0.0865
Epoch 29/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0617 - val_loss: 0.0760
Epoch 30/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0658 - val_loss: 0.0617
Epoch 31/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0617 - val_loss: 0.0600
Epoch 32/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0563 - val_loss: 0.0771
Epoch 33/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0580 - val_loss: 0.0680
Epoch 34/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0566 - val_loss: 0.0715
Epoch 35/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0562 - val_loss: 0.0747
Epoch 36/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0546 - val_loss: 0.0661
Epoch 37/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0542 - val_loss: 0.0578
Epoch 38/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0525 - val_loss: 0.0656
Epoch 39/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0532 - val_loss: 0.0711
Epoch 40/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0539 - val_loss: 0.0604
Epoch 41/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0532 - val_loss: 0.0546
Epoch 42/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0503 - val_loss: 0.0574
Epoch 43/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0497 - val_loss: 0.0554
Epoch 44/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0495 - val_loss: 0.0558
Epoch 45/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0498 - val_loss: 0.0517
Epoch 46/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0487 - val_loss: 0.0591
Epoch 47/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0494 - val_loss: 0.0609
Epoch 48/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0454 - val_loss: 0.0537
Epoch 49/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0449 - val_loss: 0.0598
Epoch 50/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0454 - val_loss: 0.0664
Epoch 51/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0442 - val_loss: 0.0659
Epoch 52/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0436 - val_loss: 0.0578
Epoch 53/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0443 - val_loss: 0.0512
Epoch 54/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0435 - val_loss: 0.0622
Epoch 55/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0424 - val_loss: 0.0557
Epoch 56/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0413 - val_loss: 0.0557
Epoch 57/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0409 - val_loss: 0.0560
Epoch 58/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0416 - val_loss: 0.0606
Epoch 59/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0540
Epoch 60/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0434 - val_loss: 0.0471
Epoch 61/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0400 - val_loss: 0.0596
Epoch 62/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0399 - val_loss: 0.0509
Epoch 63/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0402 - val_loss: 0.0592
Epoch 64/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0415 - val_loss: 0.0546
Epoch 65/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0390 - val_loss: 0.0412
Epoch 66/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0412 - val_loss: 0.0512
Epoch 67/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0383 - val_loss: 0.0489
Epoch 68/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0506
Epoch 69/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0369 - val_loss: 0.0439
Epoch 70/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0409 - val_loss: 0.0397
Epoch 71/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0380 - val_loss: 0.0495
Epoch 72/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0357 - val_loss: 0.0432
Epoch 73/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0385 - val_loss: 0.0406
Epoch 74/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0344 - val_loss: 0.0436
Epoch 75/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0344 - val_loss: 0.0452
Epoch 76/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0334 - val_loss: 0.0475
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0363 - val_loss: 0.0450
Epoch 78/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0399
Epoch 79/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0356 - val_loss: 0.0385
Epoch 80/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0365
Epoch 81/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0336 - val_loss: 0.0378
Epoch 82/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0335 - val_loss: 0.0375
Epoch 83/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0340 - val_loss: 0.0362
Epoch 84/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0343 - val_loss: 0.0358
Epoch 85/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0347 - val_loss: 0.0361
Epoch 86/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0336 - val_loss: 0.0351
Epoch 87/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0323 - val_loss: 0.0344
Epoch 88/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0301 - val_loss: 0.0322
Epoch 89/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0315 - val_loss: 0.0356
Epoch 90/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0310 - val_loss: 0.0395
Epoch 91/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0297 - val_loss: 0.0382
Epoch 92/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0319 - val_loss: 0.0342
Epoch 93/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0287 - val_loss: 0.0328
Epoch 94/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0283 - val_loss: 0.0373
Epoch 95/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0282 - val_loss: 0.0364
Epoch 96/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0285 - val_loss: 0.0317
Epoch 97/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0297 - val_loss: 0.0403
Epoch 98/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0286 - val_loss: 0.0420
Epoch 99/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0283 - val_loss: 0.0334
Epoch 100/100
68/68 [==============================] - 0s 2ms/step - loss: 0.0265 - val_loss: 0.0371
Epoch 1/100

2023-11-27 18:06:47.880319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:47.880988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:47.881361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:47.966512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:47.967001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:47.967459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:06:48.122162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:48.122627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:48.123141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 4ms/step - loss: 0.1531 - val_loss: 0.0949
Epoch 2/100
47/85 [===============>..............] - ETA: 0s - loss: 0.1266

2023-11-27 18:06:48.638613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:06:48.639410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:06:48.639874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1243 - val_loss: 0.0747
Epoch 3/100
85/85 [==============================] - 0s 2ms/step - loss: 0.1205 - val_loss: 0.0799
Epoch 4/100
85/85 [==============================] - 0s 2ms/step - loss: 0.1108 - val_loss: 0.0750
Epoch 5/100
85/85 [==============================] - 0s 2ms/step - loss: 0.1031 - val_loss: 0.0798
Epoch 6/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0929 - val_loss: 0.0719
Epoch 7/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0913 - val_loss: 0.0700
Epoch 8/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0867 - val_loss: 0.0672
Epoch 9/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0802 - val_loss: 0.0680
Epoch 10/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0764 - val_loss: 0.0663
Epoch 11/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0794 - val_loss: 0.0651
Epoch 12/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0720 - val_loss: 0.0636
Epoch 13/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0703 - val_loss: 0.0613
Epoch 14/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0694 - val_loss: 0.0617
Epoch 15/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0661 - val_loss: 0.0603
Epoch 16/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0669 - val_loss: 0.0624
Epoch 17/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0674 - val_loss: 0.0614
Epoch 18/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0650 - val_loss: 0.0614
Epoch 19/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0596 - val_loss: 0.0592
Epoch 20/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0601 - val_loss: 0.0607
Epoch 21/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0578 - val_loss: 0.0586
Epoch 22/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0541 - val_loss: 0.0591
Epoch 23/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0558 - val_loss: 0.0575
Epoch 24/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0560 - val_loss: 0.0573
Epoch 25/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0534 - val_loss: 0.0548
Epoch 26/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0520 - val_loss: 0.0558
Epoch 27/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0547 - val_loss: 0.0553
Epoch 28/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0503 - val_loss: 0.0525
Epoch 29/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0496 - val_loss: 0.0562
Epoch 30/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0528 - val_loss: 0.0544
Epoch 31/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0465 - val_loss: 0.0534
Epoch 32/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0489 - val_loss: 0.0506
Epoch 33/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0510 - val_loss: 0.0486
Epoch 34/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0457 - val_loss: 0.0570
Epoch 35/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0461 - val_loss: 0.0491
Epoch 36/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0450 - val_loss: 0.0478
Epoch 37/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0449 - val_loss: 0.0490
Epoch 38/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0430 - val_loss: 0.0493
Epoch 39/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0430 - val_loss: 0.0466
Epoch 40/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0452 - val_loss: 0.0506
Epoch 41/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0411 - val_loss: 0.0484
Epoch 42/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0420 - val_loss: 0.0481
Epoch 43/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0412 - val_loss: 0.0477
Epoch 44/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0427 - val_loss: 0.0453
Epoch 45/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0397 - val_loss: 0.0495
Epoch 46/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0389 - val_loss: 0.0486
Epoch 47/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0398 - val_loss: 0.0459
Epoch 48/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0406 - val_loss: 0.0468
Epoch 49/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0399 - val_loss: 0.0465
Epoch 50/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0393 - val_loss: 0.0447
Epoch 51/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0367 - val_loss: 0.0437
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0403
Epoch 53/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0378 - val_loss: 0.0479
Epoch 54/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0358 - val_loss: 0.0470
Epoch 55/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0365 - val_loss: 0.0408
Epoch 56/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0393 - val_loss: 0.0407
Epoch 57/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0376 - val_loss: 0.0424
Epoch 58/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0327 - val_loss: 0.0417
Epoch 59/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0387 - val_loss: 0.0405
Epoch 60/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0340 - val_loss: 0.0442
Epoch 61/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0338 - val_loss: 0.0410
Epoch 62/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0387 - val_loss: 0.0372
Epoch 63/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0342 - val_loss: 0.0389
Epoch 64/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0317 - val_loss: 0.0438
Epoch 65/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0315 - val_loss: 0.0409
Epoch 66/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0363 - val_loss: 0.0381
Epoch 67/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0305 - val_loss: 0.0432
Epoch 68/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0354 - val_loss: 0.0368
Epoch 69/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0318 - val_loss: 0.0401
Epoch 70/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0335 - val_loss: 0.0367
Epoch 71/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0324 - val_loss: 0.0351
Epoch 72/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0310 - val_loss: 0.0369
Epoch 73/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0357 - val_loss: 0.0332
Epoch 74/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0325 - val_loss: 0.0376
Epoch 75/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0331 - val_loss: 0.0351
Epoch 76/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0324 - val_loss: 0.0345
Epoch 77/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0337
Epoch 78/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0317 - val_loss: 0.0386
Epoch 79/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0348 - val_loss: 0.0327
Epoch 80/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0332 - val_loss: 0.0331
Epoch 81/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0371 - val_loss: 0.0347
Epoch 82/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0328 - val_loss: 0.0329
Epoch 83/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0352 - val_loss: 0.0327
Epoch 84/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0329 - val_loss: 0.0350
Epoch 85/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0361 - val_loss: 0.0366
Epoch 86/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0388 - val_loss: 0.0341
Epoch 87/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0363 - val_loss: 0.0293
Epoch 88/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0374 - val_loss: 0.0298
Epoch 89/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0359 - val_loss: 0.0325
Epoch 90/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0369 - val_loss: 0.0295
Epoch 91/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0373 - val_loss: 0.0295
Epoch 92/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0339 - val_loss: 0.0284
Epoch 93/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0370 - val_loss: 0.0282
Epoch 94/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0296 - val_loss: 0.0350
Epoch 95/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0323 - val_loss: 0.0267
Epoch 96/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0287 - val_loss: 0.0250
Epoch 97/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0273 - val_loss: 0.0317
Epoch 98/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0295 - val_loss: 0.0247
Epoch 99/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0272 - val_loss: 0.0264
Epoch 100/100
85/85 [==============================] - 0s 2ms/step - loss: 0.0286 - val_loss: 0.0324
Epoch 1/100

2023-11-27 18:07:06.182844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:07:06.183417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:07:06.183950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:07:06.340436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:07:06.340892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:07:06.341290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

102/102 [==============================] - 1s 2ms/step - loss: 0.0288
Epoch 2/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0281
Epoch 3/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0304
Epoch 4/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0255
Epoch 5/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0253
Epoch 6/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0256
Epoch 7/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0241
Epoch 8/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0257
Epoch 9/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0235
Epoch 10/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0284
Epoch 11/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 12/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0240
Epoch 13/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0247
Epoch 14/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0241
Epoch 15/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0224
Epoch 16/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0220
Epoch 17/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0221
Epoch 18/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0209
Epoch 19/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0209
Epoch 20/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0204
Epoch 21/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0228
Epoch 22/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0216
Epoch 23/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0261
Epoch 24/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0207
Epoch 25/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0205
Epoch 26/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0211
Epoch 27/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0200
Epoch 28/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0188
Epoch 29/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0225
Epoch 30/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0190
Epoch 31/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 32/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0221
Epoch 33/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0232
Epoch 34/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0195
Epoch 35/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0212
Epoch 36/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0211
Epoch 37/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0212
Epoch 38/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0219
Epoch 39/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0225
Epoch 40/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0212
Epoch 41/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0196
Epoch 42/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0185
Epoch 43/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0184
Epoch 44/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0190
Epoch 45/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0200
Epoch 46/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 47/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0199
Epoch 48/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0188
Epoch 49/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0228
Epoch 50/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 51/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0189
Epoch 52/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 53/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0196
Epoch 54/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0198
Epoch 55/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0243
Epoch 56/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0214
Epoch 57/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0200
Epoch 58/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 59/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0203
Epoch 60/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0189
Epoch 61/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0200
Epoch 62/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0197
Epoch 63/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0202
Epoch 64/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 65/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0188
Epoch 66/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0185
Epoch 67/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0187
Epoch 68/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0198
Epoch 69/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0178
Epoch 70/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0226
Epoch 71/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0201
Epoch 72/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0196
Epoch 73/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0192
Epoch 74/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0240
Epoch 75/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 76/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0241
Epoch 77/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0238
Epoch 78/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0280
Epoch 79/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0254
Epoch 80/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0321
Epoch 81/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0273
Epoch 82/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0250
Epoch 83/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0270
Epoch 84/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0278
Epoch 85/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0223
Epoch 86/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0210
Epoch 87/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0238
Epoch 88/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0245
Epoch 89/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0232
Epoch 90/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0249
Epoch 91/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0260
Epoch 92/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0278
Epoch 93/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0229
Epoch 94/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0247
Epoch 95/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0197
Epoch 96/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0186
Epoch 97/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0210
Epoch 98/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0193
Epoch 99/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0215
Epoch 100/100
102/102 [==============================] - 0s 2ms/step - loss: 0.0220

<keras.callbacks.History at 0x33e2561d0>

Code

# Generate predictions
train_pred = model_final.predict(X_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model_final.predict(X_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
# Ensure the index is constructed correctly for the training ground truth
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')

# Ensure the index is constructed correctly 
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()

102/102 [==============================] - 0s 599us/step
34/34 [==============================] - 0s 674us/step

2023-11-27 18:08:00.745030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:00.745475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:00.746101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Code

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}")
print(f"RMSE: {train_rmse}")
print(f"R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}")
print(f"RMSE: {test_rmse}")
print(f"R2: {test_r2}")

Training Metrics:
MAE: 0.026000731810113784
RMSE: 0.03099349464410889
R2: 0.9517904485789822

Test Metrics:
MAE: 0.04867035405712069
RMSE: 0.05973041769173671
R2: 0.8042515041695877

To tune the model and reduce overfitting, I employed a learning rate scheduler that increases the rate until epoch reaches 10 and then decays it every 10 epochs to help the model converge quickly but fine-tune slowly.

Next, the build_model function defines the architecture of the model by taking the hyperparameters I am tuning as inputs. It consists of two LSTM layers, dropout layers to prevent overfitting, and a final dense layer with a sigmoid activation function as it naturally constrains the output to be within the range of 0 to 1, which aligns with the nature of the response variable (a proportion or percentage). Then, the model is compiled with the Adam optimizer and MAE loss.

I then defined two training callbacks: 1. lr_scheduler uses LearningRateScheduler() to adjust the learning rate based on my scheduler function (Chollet, n.d.). 2. early_stopping monitors the validation loss, terminates the training process if that loss does not improve after 20 epochs, and restores the best weights observed during training.

As for the hyperparameter grid search, I decided to focus on tuning the number of neurons, dropout rates, L1 and L2 regularization strengths, and batch sizes. For these, I created lists for five hyperparameters to iterate over in nested loops to try all of the possible combinations.

Within these nested loops, cross validation is performed using tscv.split on the train data as I previously described in the base model. In each of these folds, a model is developed with the current combination of hyperparameters and trained on the training set all while monitoring that validation set’s performance and using the callbacks.

After each round of training, the best validation loss for that fold is recorded as well as the average validation loss across the folds. For the sets of hyperparameters producing a lower average validation loss than the best configuration already created, the best_val_loss and best_config variables are updated.

Once all of the hyperparameter combinations are evaluated, the final model using the best configuration obtained during hyperparameter tuning is rebuilt, compiled, and trained on the full training dataset. That model is then evaluated by various metrics.

I had various initial models that I had created that had issues that I improved on in this model. Those model versions can be found in the LSTM Initial Models section of the appendix.

Many of the issues I faced during training came down to me trying too hard to conform to the methods Professor Shi used in her LSTM notebook as I tried to normalize my data and impute missing values with zeros. I also did not implement cross validations in many of my initial models which caused both overfitting and general lack of training accuracy. Finally, I faced long run times when running the tuning for-loops due to their computational complexities.

Code

# Learning rate scheduler for training
def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1 * (epoch // 10))  # More aggressive decay every 10 epochs

# Function to build LSTM model
def build_model(input_shape, output_units=1, neurons=16, dropout=0.3, l1_reg=0.0001, l2_reg=0.0001):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units, activation='sigmoid'))
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks for training
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=20, restore_best_weights=True)

# Hyperparameters to iterate over
neurons_options = [16, 32]
dropout_options = [0.2, 0.3]
l1_reg_options = [0.0001, 0.00001]
l2_reg_options = [0.0001, 0.00001]
batch_sizes = [32, 64, 128]

# Initialize variables to track the best model configuration
best_val_loss = float('inf')
best_config = {}

# Input shape for LSTM layers
input_shape = (sequence_length, X_train.shape[2])

# Loop over all combinations of hyperparameters
for neurons in neurons_options:
    for dropout in dropout_options:
        for l1_reg in l1_reg_options:
            for l2_reg in l2_reg_options:
                for batch_size in batch_sizes:
                    print(f"Training with neurons: {neurons}, dropout: {dropout}, l1_reg: {l1_reg}, l2_reg: {l2_reg}, batch_size: {batch_size}")
                    
                    # Initialize variables for cross-validation
                    cv_val_loss = []
                    
                    for train_index, val_index in tscv.split(X_train):
                        X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
                        y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

                        # Build the model with current hyperparameters
                        model = build_model(input_shape, output_units=1, neurons=neurons, dropout=dropout, l1_reg=l1_reg, l2_reg=l2_reg)
                        
                        # Train the model on this fold
                        history = model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=batch_size,
                                            validation_data=(X_val_fold, y_val_fold), shuffle=False, callbacks=[lr_schedule, early_stopping])
                        
                        # Record the best validation loss for this fold
                        cv_val_loss.append(min(history.history['val_loss']))
                    
                    # Average validation loss across all folds
                    avg_val_loss = np.mean(cv_val_loss)
                    
                    # Update the best model configuration if the current one is better
                    if avg_val_loss < best_val_loss:
                        best_val_loss = avg_val_loss
                        best_config = {'neurons': neurons, 'dropout': dropout, 'l1_reg': l1_reg, 'l2_reg': l2_reg, 'batch_size': batch_size}
                        
                    print(f"Average Validation Loss: {avg_val_loss}")
                    print(f"Current Best Configuration: {best_config}")

# Rebuild the model using the best configuration
model_final = build_model(input_shape, output_units=1, neurons=best_config['neurons'], dropout=best_config['dropout'], l1_reg=best_config['l1_reg'], l2_reg=best_config['l2_reg'])
model_final.compile(optimizer=Adam(learning_rate=0.001), loss='mae')

# Retrain the final model on the full training data
model_final.fit(X_train, y_train, epochs=100, batch_size=best_config['batch_size'], shuffle=False, callbacks=[lr_schedule, early_stopping])

Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:08:08.375093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:08.375663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:08.376022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:08.429619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:08.430157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:08.430592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:08.512549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:08.513017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:08.513425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:08.803937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:08.804435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:08.804918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:09.041773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:09.042480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:09.042885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:09.100820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:09.101282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:09.101709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.2116 - val_loss: 0.1889 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1160

2023-11-27 18:08:09.714642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:09.715524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:09.716162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:09.781999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:09.782527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:09.782997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1636 - val_loss: 0.1803 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1541 - val_loss: 0.1718 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1455 - val_loss: 0.1659 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1325 - val_loss: 0.1648 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1347 - val_loss: 0.1526 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1174 - val_loss: 0.1460 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1031 - val_loss: 0.1397 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0962 - val_loss: 0.1332 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0976 - val_loss: 0.1267 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0920 - val_loss: 0.1520 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0914 - val_loss: 0.1384 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0805 - val_loss: 0.1335 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0815 - val_loss: 0.1146 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0753 - val_loss: 0.1325 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.1303 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0749 - val_loss: 0.1254 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.1153 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1211 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.1288 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1169 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.1230 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.1188 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.1218 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.1173 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.1167 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.1197 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.1152 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.1189 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.1181 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0657 - val_loss: 0.1197 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0652 - val_loss: 0.1215 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.1209 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.1208 - lr: 1.4996e-05
Epoch 1/100

2023-11-27 18:08:12.352046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.352695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.353079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:12.409627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.409974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.410325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:12.496338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.496951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.497512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:12.562879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.563443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.563894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:12.745270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.745696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.746111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:12.806845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:12.807303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:12.807821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1948 - val_loss: 0.1305 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1638

2023-11-27 18:08:13.305469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:13.306244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:13.306701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:13.368656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:13.369110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:13.369506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1744 - val_loss: 0.1288 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1616 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1529 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1466 - val_loss: 0.1036 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1408 - val_loss: 0.0987 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1361 - val_loss: 0.0999 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1325 - val_loss: 0.0861 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1285 - val_loss: 0.1024 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1253 - val_loss: 0.0840 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1209 - val_loss: 0.1092 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1167 - val_loss: 0.0862 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1121 - val_loss: 0.0976 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1064 - val_loss: 0.1031 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1045 - val_loss: 0.0992 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0996 - val_loss: 0.1089 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0960 - val_loss: 0.0987 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0939 - val_loss: 0.0975 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0881 - val_loss: 0.0955 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0884 - val_loss: 0.0865 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0851 - val_loss: 0.0851 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0818 - val_loss: 0.0876 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0879 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0900 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0863 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0885 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0753 - val_loss: 0.0894 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0730 - val_loss: 0.0900 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0908 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0897 - lr: 4.9787e-05
Epoch 1/100

2023-11-27 18:08:16.112088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.112798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.113265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:16.168138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.168547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.168888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:16.248677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.249153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.249593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:16.308784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.309238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.309675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:16.540972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.541677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.542118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:16.599254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:16.599716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:16.600128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 8ms/step - loss: 0.1717 - val_loss: 0.1601 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1326

2023-11-27 18:08:17.317474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:17.318055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:17.318675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:17.380728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:17.381175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:17.381538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1520 - val_loss: 0.1422 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1450 - val_loss: 0.1325 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1330 - val_loss: 0.1252 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1257 - val_loss: 0.1189 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1238 - val_loss: 0.1131 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1199 - val_loss: 0.1130 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1163 - val_loss: 0.1076 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1110 - val_loss: 0.1039 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1082 - val_loss: 0.1006 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.0989 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0987 - val_loss: 0.0919 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0949 - val_loss: 0.0923 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0897 - val_loss: 0.0830 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0863 - val_loss: 0.0855 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0753 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0805 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0706 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0715 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0683 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0660 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0678 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0666 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0616 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0603 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0587 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0582 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0579 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0578 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0580 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0580 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0579 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0579 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0579 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0579 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0579 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0578 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0578 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0579 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0579 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0579 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0579 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0579 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0579 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0579 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0579 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0579 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0579 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0579 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:08:25.311818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.312517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.312881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:25.371774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.372144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.372487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:25.456573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.457045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.457477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:25.524824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.525322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.525921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:25.768902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.769751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.770792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:25.837280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:25.837807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:25.838258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1689 - val_loss: 0.1636 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1696

2023-11-27 18:08:26.610310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:26.610913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:26.611308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:26.672843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:26.673264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:26.673646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1495 - val_loss: 0.1427 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1368 - val_loss: 0.1359 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1290 - val_loss: 0.1207 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1209 - val_loss: 0.1181 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1156 - val_loss: 0.1196 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1098 - val_loss: 0.1134 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0995 - val_loss: 0.1187 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0988 - val_loss: 0.0964 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0921 - val_loss: 0.0963 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0857 - val_loss: 0.1154 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0827 - val_loss: 0.1219 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0862 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0813 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0764 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0741 - val_loss: 0.0736 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0696 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0703 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0670 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0660 - val_loss: 0.0698 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0678 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0679 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0700 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0677 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0668 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0630 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0621 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0582 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0572 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0561 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0554 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0552 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0550 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0549 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0547 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0547 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0546 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0547 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0546 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0546 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0546 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0546 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0546 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0546 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0546 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0546 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0546 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0546 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0546 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0546 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0546 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0546 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0546 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0546 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0546 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0546 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0546 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0546 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0546 - lr: 5.0435e-10
Epoch 1/100

2023-11-27 18:08:38.489526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.490025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.490486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:38.541843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.542246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.542649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:38.623654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.624062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.624502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:38.684049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.684505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.684940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:38.916738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.917234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.917752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:38.975531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:38.976041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:38.976451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1675 - val_loss: 0.1436 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1085

2023-11-27 18:08:39.777863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:39.778345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:39.778986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:39.839683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:39.840102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:39.840481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1434 - val_loss: 0.1278 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1282 - val_loss: 0.1179 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1165 - val_loss: 0.1121 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1123 - val_loss: 0.1089 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1080 - val_loss: 0.1053 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1029 - val_loss: 0.1028 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0936 - val_loss: 0.0974 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0903 - val_loss: 0.0943 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0833 - val_loss: 0.0906 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0875 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0852 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0723 - val_loss: 0.0825 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0822 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0823 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0804 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0798 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0803 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0783 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0776 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0758 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0598 - val_loss: 0.0731 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0716 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0707 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0703 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0692 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0690 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0688 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0682 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0677 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0673 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0670 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0669 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0667 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0665 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0665 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0664 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0664 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0664 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0663 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0663 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0663 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0663 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0663 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0663 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0663 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0663 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0663 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0663 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0663 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0663 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0663 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0663 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0663 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0663 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.1370e-14
Average Validation Loss: 0.07545979768037796
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:08:58.835701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:58.836351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:58.836730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:58.891952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:58.892299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:58.892731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:58.978683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:58.979211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:58.979704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:59.042076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:59.042808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:59.043317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:59.289328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:59.290151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:59.290634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:08:59.354462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:59.355052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:59.355497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 37ms/step - loss: 0.2275 - val_loss: 0.1950 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1448

2023-11-27 18:08:59.963614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:08:59.964166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:08:59.964506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:00.030775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:00.031167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:00.031540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 5ms/step - loss: 0.1712 - val_loss: 0.1872 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1652 - val_loss: 0.1843 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1610 - val_loss: 0.1782 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1567 - val_loss: 0.1710 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1501 - val_loss: 0.1640 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1401 - val_loss: 0.1617 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1395 - val_loss: 0.1575 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1308 - val_loss: 0.1485 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1224 - val_loss: 0.1460 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1139 - val_loss: 0.1382 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1024 - val_loss: 0.1372 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.1346 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.1363 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.1412 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.1352 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0868 - val_loss: 0.1345 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0881 - val_loss: 0.1329 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0843 - val_loss: 0.1346 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.1260 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1335 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.1307 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1272 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.1290 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1301 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.1300 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.1293 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0794 - val_loss: 0.1286 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1275 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0813 - val_loss: 0.1276 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1279 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1282 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.1281 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.1281 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1278 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1276 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.1275 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1274 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1274 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.1274 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:09:01.998753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:01.999420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.000004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:02.061060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.061453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.061772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:02.144760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.145259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.145675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:02.206325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.206953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.207532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:02.389012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.389481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.389893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:02.448642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.449108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.449719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

15/17 [=========================>....] - ETA: 0s - loss: 0.2051 

2023-11-27 18:09:02.915324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:02.915905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:02.916394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 39ms/step - loss: 0.1989 - val_loss: 0.1449 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1767 - val_loss: 0.1374 - lr: 0.0010
Epoch 3/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1031

2023-11-27 18:09:03.292068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:03.292561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:03.293120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1663 - val_loss: 0.1291 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1579 - val_loss: 0.1175 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1527 - val_loss: 0.1124 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1481 - val_loss: 0.1060 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1349 - val_loss: 0.1051 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1296 - val_loss: 0.1003 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1260 - val_loss: 0.1008 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1211 - val_loss: 0.0913 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1120 - val_loss: 0.0915 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1098 - val_loss: 0.0904 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1063 - val_loss: 0.0875 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1021 - val_loss: 0.0879 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0973 - val_loss: 0.0896 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0953 - val_loss: 0.0875 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0933 - val_loss: 0.0845 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0905 - val_loss: 0.0849 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0892 - val_loss: 0.0838 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0865 - val_loss: 0.0796 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0869 - val_loss: 0.0801 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0797 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0833 - val_loss: 0.0802 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0804 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0769 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0802 - val_loss: 0.0801 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0783 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.0799 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0772 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0797 - val_loss: 0.0782 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0789 - val_loss: 0.0785 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0791 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0782 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0780 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0794 - val_loss: 0.0781 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0799 - val_loss: 0.0781 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0783 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0795 - val_loss: 0.0782 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0789 - val_loss: 0.0782 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0787 - val_loss: 0.0781 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0781 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0782 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0805 - val_loss: 0.0782 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.0782 - lr: 3.3546e-07
Epoch 1/100

2023-11-27 18:09:06.032656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.033675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.034245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:06.094510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.094922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.095276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:06.182788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.183512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.184134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:06.249396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.250119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.250667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:06.489340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.490044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.490587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:06.552237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:06.552706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:06.553121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1895 - val_loss: 0.1725 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1201

2023-11-27 18:09:07.184064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:07.184560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:07.185254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:07.247103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:07.247548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:07.247974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1552 - val_loss: 0.1610 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1475 - val_loss: 0.1453 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1379 - val_loss: 0.1302 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1300 - val_loss: 0.1173 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1244 - val_loss: 0.1086 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1194 - val_loss: 0.1039 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1145 - val_loss: 0.1007 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1111 - val_loss: 0.0956 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1033 - val_loss: 0.0879 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0973 - val_loss: 0.0835 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0948 - val_loss: 0.0818 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0955 - val_loss: 0.0825 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0977 - val_loss: 0.0795 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0976 - val_loss: 0.0782 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0983 - val_loss: 0.0837 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0908 - val_loss: 0.0782 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0885 - val_loss: 0.0748 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0853 - val_loss: 0.0736 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0847 - val_loss: 0.0740 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0832 - val_loss: 0.0757 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0825 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0769 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0789 - val_loss: 0.0767 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.0758 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.0762 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.0769 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0767 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0754 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0753 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0753 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0753 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0752 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.0752 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0749 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0750 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0752 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0753 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0749 - val_loss: 0.0752 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:09:11.163606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.164200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.164560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:11.217108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.217506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.217857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:11.297111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.297607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.298019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:11.357946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.358424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.358859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:11.598124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.598688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.599109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:11.657477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:11.657975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:11.658400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1931 - val_loss: 0.1655 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1364

2023-11-27 18:09:12.340288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:12.340953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:12.341353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:12.401306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:12.401741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:12.402146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1572 - val_loss: 0.1606 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1473 - val_loss: 0.1559 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1362 - val_loss: 0.1556 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1310 - val_loss: 0.1488 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1236 - val_loss: 0.1437 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1188 - val_loss: 0.1346 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1136 - val_loss: 0.1342 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1096 - val_loss: 0.1268 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1067 - val_loss: 0.1351 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.1328 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1003 - val_loss: 0.1360 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0997 - val_loss: 0.1325 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.1371 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1020 - val_loss: 0.1334 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1039 - val_loss: 0.1179 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0982 - val_loss: 0.1172 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.1070 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0913 - val_loss: 0.1056 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0893 - val_loss: 0.1035 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.0965 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0844 - val_loss: 0.0937 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0826 - val_loss: 0.0910 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0820 - val_loss: 0.0874 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0802 - val_loss: 0.0863 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0847 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0844 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0831 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0826 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0775 - val_loss: 0.0817 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0819 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.0817 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0772 - val_loss: 0.0817 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.0813 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0811 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0811 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0809 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0808 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0807 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0763 - val_loss: 0.0807 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0807 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0755 - val_loss: 0.0807 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0807 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0807 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0807 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0807 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0762 - val_loss: 0.0807 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0807 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0807 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0756 - val_loss: 0.0807 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0807 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0771 - val_loss: 0.0807 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0807 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0807 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0807 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0807 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0757 - val_loss: 0.0807 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0807 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0807 - lr: 5.0435e-10
Epoch 1/100

2023-11-27 18:09:19.675284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:19.675926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:19.676284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:19.729094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:19.729479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:19.729820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:19.809253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:19.809747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:19.810166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:19.870232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:19.870687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:19.871102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:20.103146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:20.103601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:20.104038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:20.162229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:20.162688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:20.163106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1892 - val_loss: 0.1571 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1214

2023-11-27 18:09:20.870773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:20.871340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:20.872065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:20.938864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:20.939258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:20.939667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1572 - val_loss: 0.1454 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1423 - val_loss: 0.1348 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1330 - val_loss: 0.1280 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1248 - val_loss: 0.1223 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1184 - val_loss: 0.1183 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1142 - val_loss: 0.1154 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1092 - val_loss: 0.1129 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1035 - val_loss: 0.1100 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0997 - val_loss: 0.1081 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0964 - val_loss: 0.1073 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0922 - val_loss: 0.1066 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0886 - val_loss: 0.1052 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0844 - val_loss: 0.1053 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0831 - val_loss: 0.1044 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0807 - val_loss: 0.1041 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.1030 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.1021 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0741 - val_loss: 0.1017 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.1011 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.1009 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.1011 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.1033 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0743 - val_loss: 0.1041 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.1030 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0734 - val_loss: 0.0999 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0991 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0986 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0980 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0978 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0975 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0973 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0972 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0971 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0970 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0665 - val_loss: 0.0970 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0969 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0665 - val_loss: 0.0969 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0969 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0969 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0666 - val_loss: 0.0969 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0969 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.0969 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0969 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0969 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0969 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0969 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0969 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0969 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0969 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0969 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0660 - val_loss: 0.0969 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0650 - val_loss: 0.0969 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0969 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0969 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0969 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0969 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0662 - val_loss: 0.0969 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0969 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0969 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0969 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0969 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0969 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0969 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0969 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0969 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0969 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0969 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0969 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0969 - lr: 2.2897e-14
Average Validation Loss: 0.09081211388111114
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:09:32.093798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.094496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.094949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:32.147130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.147525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.147875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:32.229669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.230167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.230646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:32.289819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.290272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.290689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:32.541026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.542058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.542558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:32.613320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:32.613872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:32.614481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 69ms/step - loss: 0.2473 - val_loss: 0.2097 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1458

2023-11-27 18:09:33.241596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:33.242125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:33.242870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:33.308567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:33.309369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:33.309839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1748 - val_loss: 0.1850 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1611 - val_loss: 0.1917 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1655 - val_loss: 0.1968 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1685 - val_loss: 0.1968 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1675 - val_loss: 0.1912 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1618 - val_loss: 0.1831 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1600 - val_loss: 0.1756 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1541 - val_loss: 0.1690 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1471 - val_loss: 0.1643 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1442 - val_loss: 0.1628 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1383 - val_loss: 0.1613 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1329 - val_loss: 0.1591 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1329 - val_loss: 0.1550 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1275 - val_loss: 0.1509 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1218 - val_loss: 0.1489 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1201 - val_loss: 0.1468 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1156 - val_loss: 0.1464 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1125 - val_loss: 0.1440 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1101 - val_loss: 0.1411 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1073 - val_loss: 0.1406 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1050 - val_loss: 0.1383 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1031 - val_loss: 0.1371 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1019 - val_loss: 0.1371 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1032 - val_loss: 0.1373 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1033 - val_loss: 0.1375 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1010 - val_loss: 0.1376 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1025 - val_loss: 0.1364 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1031 - val_loss: 0.1355 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1011 - val_loss: 0.1357 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1360 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1008 - val_loss: 0.1359 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1011 - val_loss: 0.1358 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1356 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1015 - val_loss: 0.1355 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1014 - val_loss: 0.1355 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1000 - val_loss: 0.1354 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1011 - val_loss: 0.1354 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1009 - val_loss: 0.1355 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1355 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0997 - val_loss: 0.1355 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.1355 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1002 - val_loss: 0.1355 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0984 - val_loss: 0.1355 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0974 - val_loss: 0.1355 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1355 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1005 - val_loss: 0.1355 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1003 - val_loss: 0.1355 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1005 - val_loss: 0.1355 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0992 - val_loss: 0.1355 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1355 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1355 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0996 - val_loss: 0.1355 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1001 - val_loss: 0.1355 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1003 - val_loss: 0.1355 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1001 - val_loss: 0.1355 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0985 - val_loss: 0.1355 - lr: 1.3710e-09
Epoch 1/100

2023-11-27 18:09:35.467538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.467995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.468599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:35.523318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.523760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.524109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:35.612741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.613224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.613841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:35.682498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.683041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.683733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:35.931178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.931730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.932180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:35.990719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:35.991192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:35.991612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 40ms/step - loss: 0.2295 - val_loss: 0.1667 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1516

2023-11-27 18:09:36.590458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:36.591525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:36.592019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:36.664497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:36.664996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:36.665399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.1881 - val_loss: 0.1457 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1800 - val_loss: 0.1403 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1700 - val_loss: 0.1413 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1592 - val_loss: 0.1327 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1496 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1422 - val_loss: 0.1259 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1363 - val_loss: 0.1191 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1316 - val_loss: 0.1208 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1250 - val_loss: 0.1146 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1208 - val_loss: 0.1259 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1172 - val_loss: 0.1162 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1159 - val_loss: 0.1213 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1134 - val_loss: 0.1113 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1103 - val_loss: 0.1247 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1104 - val_loss: 0.1130 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1088 - val_loss: 0.1160 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1070 - val_loss: 0.1132 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1052 - val_loss: 0.1163 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1034 - val_loss: 0.1209 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1033 - val_loss: 0.1090 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1028 - val_loss: 0.1106 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1011 - val_loss: 0.1147 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1022 - val_loss: 0.1115 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1023 - val_loss: 0.1127 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1008 - val_loss: 0.1127 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0998 - val_loss: 0.1111 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0997 - val_loss: 0.1109 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0998 - val_loss: 0.1113 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0993 - val_loss: 0.1125 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1002 - val_loss: 0.1130 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0990 - val_loss: 0.1126 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1003 - val_loss: 0.1123 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1001 - val_loss: 0.1120 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0995 - val_loss: 0.1120 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0984 - val_loss: 0.1120 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0992 - val_loss: 0.1120 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1001 - val_loss: 0.1120 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0983 - val_loss: 0.1121 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0996 - val_loss: 0.1121 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0991 - val_loss: 0.1121 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:09:38.892219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:38.892587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:38.892997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:38.947277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:38.947671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:38.948034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:39.036111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:39.036874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:39.037511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:39.103177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:39.103853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:39.104324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:39.343281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:39.343847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:39.344277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:39.402310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:39.402765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:39.403194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 26ms/step - loss: 0.2165 - val_loss: 0.1908 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1690

2023-11-27 18:09:40.007717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:40.008273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:40.008795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:40.072907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:40.073408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:40.073914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 5ms/step - loss: 0.1747 - val_loss: 0.1729 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1646 - val_loss: 0.1709 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1515 - val_loss: 0.1573 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1415 - val_loss: 0.1445 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1367 - val_loss: 0.1336 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1295 - val_loss: 0.1236 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1227 - val_loss: 0.1145 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1179 - val_loss: 0.1066 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1129 - val_loss: 0.1023 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1061 - val_loss: 0.0992 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1020 - val_loss: 0.0952 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0988 - val_loss: 0.0919 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.0896 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.0892 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0891 - val_loss: 0.0871 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0883 - val_loss: 0.0843 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0830 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0812 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0814 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0803 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0798 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.0802 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0794 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0797 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.0797 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0797 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0809 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0788 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0787 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0788 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0788 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0787 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0787 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0787 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0787 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0787 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0787 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0787 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0787 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0787 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0787 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0800 - val_loss: 0.0787 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0787 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0787 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0787 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0787 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0787 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0787 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0787 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0787 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0787 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0787 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.0787 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0787 - lr: 1.3710e-09
Epoch 1/100

2023-11-27 18:09:43.972086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:43.972578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:43.972904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:44.031984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:44.032461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:44.032882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:44.122275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:44.122814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:44.123406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:44.192270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:44.192832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:44.193505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:44.453791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:44.454539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:44.455172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:44.520633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:44.521274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:44.521776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.2508 - val_loss: 0.1621 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1680

2023-11-27 18:09:45.173579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:45.174055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:45.174561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:45.236459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:45.236995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:45.237436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1770 - val_loss: 0.1642 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1685 - val_loss: 0.1505 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1546 - val_loss: 0.1426 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1437 - val_loss: 0.1344 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1344 - val_loss: 0.1396 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1324 - val_loss: 0.1346 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1280 - val_loss: 0.1272 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1221 - val_loss: 0.1263 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1187 - val_loss: 0.1227 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1162 - val_loss: 0.1187 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1108 - val_loss: 0.1080 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1064 - val_loss: 0.1142 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1068 - val_loss: 0.1044 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1025 - val_loss: 0.1014 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0999 - val_loss: 0.0982 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0972 - val_loss: 0.0958 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.0928 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0946 - val_loss: 0.0919 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.0881 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.0868 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.0843 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0884 - val_loss: 0.0843 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0875 - val_loss: 0.0839 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.0820 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0817 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0819 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0810 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0804 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0814 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0808 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0804 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0801 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0850 - val_loss: 0.0801 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0802 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0802 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0802 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0801 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0801 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0801 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0801 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0801 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0801 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0801 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0801 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0801 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0801 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0801 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0801 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0801 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0801 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0801 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0801 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0801 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0801 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0801 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0801 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0801 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0801 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0801 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.0801 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0801 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0801 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0801 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0801 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0801 - lr: 8.3584e-12
Epoch 1/100

2023-11-27 18:09:51.018668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.019318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.019739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:51.074225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.074635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.074983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:51.158925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.159407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.159814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:51.219560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.220009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.220467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:51.917811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.918419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.918887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:51.980224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:51.980728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:51.981183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 2s 17ms/step - loss: 0.1784 - val_loss: 0.1652 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1841

2023-11-27 18:09:52.639962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:52.640509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:52.641161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:09:52.703374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:09:52.703812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:09:52.704199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1611 - val_loss: 0.1588 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1497 - val_loss: 0.1518 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1415 - val_loss: 0.1462 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1372 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1321 - val_loss: 0.1376 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1248 - val_loss: 0.1324 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1191 - val_loss: 0.1290 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1178 - val_loss: 0.1269 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1157 - val_loss: 0.1263 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1127 - val_loss: 0.1238 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1078 - val_loss: 0.1206 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1203 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1026 - val_loss: 0.1167 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0998 - val_loss: 0.1153 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0973 - val_loss: 0.1133 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1113 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0936 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.1089 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.1080 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.1051 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.1042 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.1034 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1020 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.1016 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.1006 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1001 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.0999 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0994 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.0991 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0990 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0989 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0987 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0985 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0805 - val_loss: 0.0984 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0983 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0983 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0983 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.0983 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0983 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0983 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.0983 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0983 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0982 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0982 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0982 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0806 - val_loss: 0.0982 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0805 - val_loss: 0.0982 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.0982 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0982 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0810 - val_loss: 0.0982 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0982 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0982 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0982 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0982 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0982 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0810 - val_loss: 0.0982 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0982 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0798 - val_loss: 0.0982 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0982 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0792 - val_loss: 0.0982 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.0982 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0982 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0982 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0982 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0982 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0982 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0982 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0982 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0982 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0982 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.0982 - lr: 1.8698e-13
Average Validation Loss: 0.10029301941394805
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:10:00.119975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.120399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.120988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:00.171985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.172352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.172699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:00.252765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.253238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.253693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:00.312791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.313265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.313682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:00.556543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.557333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.557811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:00.616141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:00.616600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:00.617030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.1609 - val_loss: 0.1755 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1228

2023-11-27 18:10:01.235598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:01.236163: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:01.236661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:01.302820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:01.303322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:01.303703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1563 - val_loss: 0.1656 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1462 - val_loss: 0.1532 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1325 - val_loss: 0.1517 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1193 - val_loss: 0.1525 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1118 - val_loss: 0.1501 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1083 - val_loss: 0.1459 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.1422 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0939 - val_loss: 0.1228 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0952 - val_loss: 0.1212 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.1312 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0772 - val_loss: 0.1314 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.1287 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0726 - val_loss: 0.1155 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.1194 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.1444 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0757 - val_loss: 0.1135 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.1198 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.1258 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0655 - val_loss: 0.1175 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.1228 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.1200 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.1192 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.1219 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.1198 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.1166 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.1210 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.1227 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.1192 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.1158 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.1147 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.1172 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.1188 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.1199 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.1201 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.1197 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.1194 - lr: 6.0967e-06
Epoch 1/100

2023-11-27 18:10:03.979401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:03.979923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:03.980262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.031401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.031757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.032081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.115540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.116429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.117157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.183453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.184134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.184568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.366055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.366517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.366854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.425311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.425747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.426185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1754 - val_loss: 0.1173 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1144

2023-11-27 18:10:04.907050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.907524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.908203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:04.969454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:04.969914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:04.970297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1641 - val_loss: 0.1083 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1524 - val_loss: 0.1139 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1461 - val_loss: 0.0952 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1401 - val_loss: 0.1006 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1359 - val_loss: 0.0884 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1268 - val_loss: 0.0977 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1222 - val_loss: 0.0885 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1256 - val_loss: 0.0849 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1154 - val_loss: 0.1085 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1152 - val_loss: 0.0807 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1061 - val_loss: 0.1006 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1033 - val_loss: 0.0899 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1005 - val_loss: 0.0886 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0955 - val_loss: 0.0843 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0894 - val_loss: 0.0830 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0843 - val_loss: 0.0804 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0770 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0807 - val_loss: 0.0749 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0757 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0735 - val_loss: 0.0768 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0732 - val_loss: 0.0750 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0775 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0704 - val_loss: 0.0773 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0694 - val_loss: 0.0750 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0704 - val_loss: 0.0793 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0815 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0792 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0806 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0813 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0668 - val_loss: 0.0815 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0668 - val_loss: 0.0810 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0809 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0806 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0810 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0812 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0815 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0665 - val_loss: 0.0816 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0814 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:10:08.443649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.444029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.444645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:08.496969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.497335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.497688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:08.582050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.582882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.583356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:08.651066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.651658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.652273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:08.898765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.899324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.899758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:08.959237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:08.959708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:08.960131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 8ms/step - loss: 0.1746 - val_loss: 0.1604 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1264

2023-11-27 18:10:09.672907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:09.673377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:09.674015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:09.735308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:09.735768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:09.736166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1498 - val_loss: 0.1432 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1378 - val_loss: 0.1304 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1318 - val_loss: 0.1227 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1265 - val_loss: 0.1156 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1214 - val_loss: 0.1115 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1186 - val_loss: 0.1087 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1146 - val_loss: 0.1061 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1091 - val_loss: 0.1008 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1028 - val_loss: 0.0952 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.0986 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0920 - val_loss: 0.0812 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0937 - val_loss: 0.0853 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0736 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0748 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0691 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0634 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0622 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0613 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0607 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0595 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0577 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0587 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0586 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0597 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0595 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0593 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0596 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0597 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0601 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0604 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0599 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0595 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0598 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0598 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0598 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0598 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0598 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0598 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0598 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0598 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0598 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:10:17.200086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.200803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.201155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:17.262576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.263058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.263401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:17.353124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.353610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.354301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:17.418195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.418815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.419574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:17.666847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.667308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.667761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:17.727059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:17.727524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:17.727900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1559 - val_loss: 0.1503 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1469

2023-11-27 18:10:18.491768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:18.492348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:18.492754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:18.554019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:18.554457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:18.554846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1391 - val_loss: 0.1323 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1261 - val_loss: 0.1221 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1165 - val_loss: 0.1194 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0994 - val_loss: 0.1201 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0946 - val_loss: 0.1204 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0864 - val_loss: 0.1316 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0824 - val_loss: 0.1250 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.1331 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.1171 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0723 - val_loss: 0.1053 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.1011 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0908 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0793 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0725 - val_loss: 0.0711 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0691 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0664 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0644 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0678 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0660 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0604 - val_loss: 0.0708 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0758 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0759 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0718 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0667 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0622 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0600 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0608 - val_loss: 0.0585 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0580 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0577 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0576 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0575 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0575 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0575 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0574 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0574 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0574 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0574 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0574 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0574 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0574 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0573 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0573 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0573 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0573 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0573 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0573 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0573 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0573 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0573 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0573 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0573 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0573 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0573 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0573 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0573 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0573 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0573 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0573 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0573 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0573 - val_loss: 0.0573 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0573 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0582 - val_loss: 0.0573 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0573 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0573 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0573 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0573 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0573 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0572 - val_loss: 0.0573 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0573 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0573 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0573 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0573 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0573 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0573 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0573 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0573 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0573 - lr: 6.9144e-16
Epoch 1/100

2023-11-27 18:10:35.269255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.269890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.270497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:35.324393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.324781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.325135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:35.406890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.407347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.407773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:35.467818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.468288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.468733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:35.708556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.709106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.709541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:35.769220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:35.769709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:35.770156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1596 - val_loss: 0.1348 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0861

2023-11-27 18:10:36.583973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:36.584443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:36.585106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:36.645393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:36.645826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:36.646236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1359 - val_loss: 0.1197 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1223 - val_loss: 0.1154 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1164 - val_loss: 0.1113 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1117 - val_loss: 0.1090 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1065 - val_loss: 0.1034 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0980 - val_loss: 0.1003 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0954 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0909 - val_loss: 0.0919 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0848 - val_loss: 0.0885 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0798 - val_loss: 0.0850 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0762 - val_loss: 0.0822 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0806 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0809 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0790 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0666 - val_loss: 0.0783 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0779 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0772 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0755 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0748 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0601 - val_loss: 0.0737 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0710 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0704 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0704 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0706 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0704 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0705 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0707 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0707 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0705 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0700 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0698 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0695 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0694 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0694 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0694 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0693 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0694 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0694 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0694 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0694 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0694 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0694 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0694 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0694 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0694 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0694 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0694 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0694 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0694 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0694 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0694 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0694 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0694 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0694 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0694 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0694 - lr: 8.3153e-10
Average Validation Loss: 0.07449577599763871
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:10:51.433016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.433479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.433904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:51.484661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.485062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.485435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:51.564876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.565343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.565784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:51.625650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.626107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.626522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:51.874302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.874888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.875373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:51.937623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:51.938051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:51.938479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.2392 - val_loss: 0.2010 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1568

2023-11-27 18:10:52.532044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:52.532490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:52.533089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:52.593429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:52.593879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:52.594413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1731 - val_loss: 0.1825 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1610 - val_loss: 0.1828 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1600 - val_loss: 0.1793 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1535 - val_loss: 0.1726 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1477 - val_loss: 0.1657 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1416 - val_loss: 0.1601 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1357 - val_loss: 0.1565 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1331 - val_loss: 0.1520 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1285 - val_loss: 0.1465 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1246 - val_loss: 0.1418 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1137 - val_loss: 0.1400 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1109 - val_loss: 0.1349 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1007 - val_loss: 0.1342 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0984 - val_loss: 0.1313 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.1327 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.1296 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.1326 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.1304 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.1329 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.1287 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.1343 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.1294 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0782 - val_loss: 0.1299 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1314 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.1290 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.1283 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.1287 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.1286 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.1284 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.1288 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1287 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0751 - val_loss: 0.1289 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0759 - val_loss: 0.1290 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1289 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.1288 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.1288 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.1288 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.1287 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.1287 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0745 - val_loss: 0.1287 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.1287 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.1287 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.1287 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.1287 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.1287 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.1287 - lr: 1.5073e-07
Epoch 1/100

2023-11-27 18:10:54.911205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:54.911628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:54.912198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:54.964225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:54.964611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:54.964974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:55.042805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.043284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.043700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:55.102778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.103184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.103603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:55.295628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.296216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.296642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:55.355664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.356134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.356583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.1939 - val_loss: 0.1349 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1237

2023-11-27 18:10:55.834371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.834835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.835531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:55.896540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:55.896963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:55.897443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 3ms/step - loss: 0.1723 - val_loss: 0.1311 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1563 - val_loss: 0.1204 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1432 - val_loss: 0.1116 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1352 - val_loss: 0.1071 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1283 - val_loss: 0.0995 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1228 - val_loss: 0.0992 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1153 - val_loss: 0.1018 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1111 - val_loss: 0.1006 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1043 - val_loss: 0.0965 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1021 - val_loss: 0.0960 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0984 - val_loss: 0.0915 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0939 - val_loss: 0.0916 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0915 - val_loss: 0.0918 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.0879 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0868 - val_loss: 0.0860 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0850 - val_loss: 0.0816 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0814 - val_loss: 0.0833 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0804 - val_loss: 0.0855 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0802 - val_loss: 0.0826 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0790 - val_loss: 0.0819 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0785 - val_loss: 0.0837 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0836 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.0827 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0765 - val_loss: 0.0820 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0763 - val_loss: 0.0822 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0765 - val_loss: 0.0808 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0830 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0755 - val_loss: 0.0816 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0819 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0755 - val_loss: 0.0813 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0804 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.0806 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0810 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0813 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0814 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.0814 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0814 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0813 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0744 - val_loss: 0.0813 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0742 - val_loss: 0.0813 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0813 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.0813 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.0813 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0813 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0743 - val_loss: 0.0813 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0813 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0758 - val_loss: 0.0813 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0813 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0813 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0813 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0813 - lr: 1.6702e-08
Epoch 1/100

2023-11-27 18:10:59.047234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:59.047697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:59.048306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:59.101531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:59.101949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:59.102339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:59.687507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:59.688116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:59.688545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:10:59.753081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:10:59.753656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:10:59.754087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:00.009951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:00.010643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:00.011092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:00.071478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:00.071994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:00.072424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 2s 14ms/step - loss: 0.1795 - val_loss: 0.1588 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1253

2023-11-27 18:11:00.704527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:00.705277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:00.705606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:00.765970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:00.766410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:00.766800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1523 - val_loss: 0.1516 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1402 - val_loss: 0.1327 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1324 - val_loss: 0.1202 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1254 - val_loss: 0.1137 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1210 - val_loss: 0.1084 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1137 - val_loss: 0.1031 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1089 - val_loss: 0.1003 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1063 - val_loss: 0.0974 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1029 - val_loss: 0.0954 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0980 - val_loss: 0.0931 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0973 - val_loss: 0.0900 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0942 - val_loss: 0.0872 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0926 - val_loss: 0.0837 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.0807 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0856 - val_loss: 0.0791 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.0775 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0817 - val_loss: 0.0749 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0734 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0779 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0770 - val_loss: 0.0693 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0767 - val_loss: 0.0698 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0690 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0690 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0688 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0690 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0681 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0686 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0690 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.0686 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0692 - val_loss: 0.0681 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.0677 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0682 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0681 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0682 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0680 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0680 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0681 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0681 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0682 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0682 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0682 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.0682 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0682 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0682 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0682 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0682 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0682 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0682 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0682 - val_loss: 0.0682 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0682 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0682 - lr: 1.6702e-08
Epoch 1/100

2023-11-27 18:11:06.124967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.125761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.126247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:06.183088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.183607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.184051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:06.269254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.269742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.270150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:06.331234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.331870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.332389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:06.583470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.584030: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.584466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:06.643720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:06.644253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:06.644723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1762 - val_loss: 0.1520 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1215

2023-11-27 18:11:07.335526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:07.336181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:07.336607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:07.401365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:07.401870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:07.402255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1491 - val_loss: 0.1392 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1282 - val_loss: 0.1198 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1122 - val_loss: 0.1036 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1016 - val_loss: 0.0946 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0966 - val_loss: 0.0900 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0897 - val_loss: 0.0876 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0862 - val_loss: 0.0841 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0846 - val_loss: 0.0825 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.0795 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0790 - val_loss: 0.0840 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0772 - val_loss: 0.0785 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0762 - val_loss: 0.0765 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0798 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0757 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.0817 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0765 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0771 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.0855 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0820 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0933 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0941 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0763 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0670 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0614 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0598 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0682 - val_loss: 0.0563 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0558 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0650 - val_loss: 0.0560 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.0554 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0645 - val_loss: 0.0550 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0553 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0550 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0548 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0546 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0546 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.0546 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0546 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.0546 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0546 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0546 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0547 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0547 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0546 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.0547 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0547 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.0547 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0547 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.0547 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.0547 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0547 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0547 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0547 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0632 - val_loss: 0.0547 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.0547 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0630 - val_loss: 0.0547 - lr: 2.2603e-09
Epoch 1/100

2023-11-27 18:11:14.656183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:14.656719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:14.657056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:14.714413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:14.714883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:14.715299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:14.797395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:14.797873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:14.798256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:14.858681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:14.859308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:14.859749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:15.099876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:15.100536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:15.100986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:15.161396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:15.161897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:15.162328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1773 - val_loss: 0.1520 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1109

2023-11-27 18:11:15.900080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:15.900569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:15.901250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:15.964389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:15.964870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:15.965314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1494 - val_loss: 0.1402 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1367 - val_loss: 0.1321 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1234 - val_loss: 0.1242 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1138 - val_loss: 0.1189 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1091 - val_loss: 0.1155 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1056 - val_loss: 0.1131 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.1114 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1010 - val_loss: 0.1113 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.1075 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.1044 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0912 - val_loss: 0.1019 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0886 - val_loss: 0.1009 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0856 - val_loss: 0.0984 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0840 - val_loss: 0.0972 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0822 - val_loss: 0.0956 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.0941 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0930 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0753 - val_loss: 0.0915 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.0912 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0744 - val_loss: 0.0912 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0926 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0751 - val_loss: 0.0941 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0938 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0741 - val_loss: 0.0902 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0723 - val_loss: 0.0870 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0857 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.0851 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0843 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0840 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0838 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0837 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0836 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0835 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0834 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0834 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0834 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0833 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0665 - val_loss: 0.0833 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0833 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0833 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0833 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0833 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0833 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0833 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0833 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0833 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0833 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0667 - val_loss: 0.0833 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0833 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0833 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0833 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0833 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0833 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0833 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0665 - val_loss: 0.0833 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0833 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0833 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0833 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0833 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0833 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.0833 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0833 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0833 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0833 - lr: 5.6464e-15
Average Validation Loss: 0.08284749686717988
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:11:27.892647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:27.893102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:27.893655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:27.949117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:27.949565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:27.949863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:28.034678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:28.035214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:28.035725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:28.099855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:28.100480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:28.100974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:28.345095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:28.345910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:28.346364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:28.407401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:28.407901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:28.408355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 69ms/step - loss: 0.2732 - val_loss: 0.2248 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1500

2023-11-27 18:11:28.996635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:28.997142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:28.997859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:29.060977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:29.061412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:29.061807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1904 - val_loss: 0.1849 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1631 - val_loss: 0.1862 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1598 - val_loss: 0.1892 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1658 - val_loss: 0.1889 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1635 - val_loss: 0.1845 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1571 - val_loss: 0.1773 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1502 - val_loss: 0.1703 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1459 - val_loss: 0.1653 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1412 - val_loss: 0.1623 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1382 - val_loss: 0.1614 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1344 - val_loss: 0.1615 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1290 - val_loss: 0.1610 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1256 - val_loss: 0.1597 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1574 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1226 - val_loss: 0.1551 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1151 - val_loss: 0.1553 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1144 - val_loss: 0.1563 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1125 - val_loss: 0.1557 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1103 - val_loss: 0.1535 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1116 - val_loss: 0.1513 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1077 - val_loss: 0.1494 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1055 - val_loss: 0.1489 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1075 - val_loss: 0.1486 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1044 - val_loss: 0.1492 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1029 - val_loss: 0.1490 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1048 - val_loss: 0.1486 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1008 - val_loss: 0.1482 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1014 - val_loss: 0.1478 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1037 - val_loss: 0.1476 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.1476 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1031 - val_loss: 0.1476 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1016 - val_loss: 0.1476 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1017 - val_loss: 0.1476 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1015 - val_loss: 0.1476 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1005 - val_loss: 0.1476 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1009 - val_loss: 0.1476 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1039 - val_loss: 0.1476 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1033 - val_loss: 0.1476 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1476 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1007 - val_loss: 0.1476 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1015 - val_loss: 0.1476 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1015 - val_loss: 0.1476 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1024 - val_loss: 0.1476 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1019 - val_loss: 0.1476 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1004 - val_loss: 0.1476 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1022 - val_loss: 0.1476 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1020 - val_loss: 0.1476 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1018 - val_loss: 0.1476 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1015 - val_loss: 0.1476 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1014 - val_loss: 0.1476 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1476 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1024 - val_loss: 0.1476 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0998 - val_loss: 0.1476 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0997 - val_loss: 0.1476 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:11:31.149093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.149813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.150143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:31.205063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.205453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.205854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:31.293007: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.293478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.293893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:31.354504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.355024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.355570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:31.593615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.594267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.594714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:31.655516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:31.656045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:31.656486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1769 - val_loss: 0.1281 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1481

2023-11-27 18:11:32.266168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:32.266664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:32.267347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:32.328594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:32.329019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:32.329501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1660 - val_loss: 0.1177 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1581 - val_loss: 0.1237 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1508 - val_loss: 0.1267 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1419 - val_loss: 0.1157 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1374 - val_loss: 0.1180 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1302 - val_loss: 0.1226 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1239 - val_loss: 0.1228 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1216 - val_loss: 0.1233 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1152 - val_loss: 0.1220 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1156 - val_loss: 0.1187 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1094 - val_loss: 0.1234 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1071 - val_loss: 0.1153 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1048 - val_loss: 0.1220 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1012 - val_loss: 0.1179 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1005 - val_loss: 0.1172 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.1197 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0973 - val_loss: 0.1186 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0945 - val_loss: 0.1162 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0930 - val_loss: 0.1171 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0937 - val_loss: 0.1146 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0917 - val_loss: 0.1133 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0916 - val_loss: 0.1139 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0917 - val_loss: 0.1122 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0901 - val_loss: 0.1141 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0895 - val_loss: 0.1121 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0897 - val_loss: 0.1110 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0885 - val_loss: 0.1125 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0891 - val_loss: 0.1132 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0894 - val_loss: 0.1138 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0884 - val_loss: 0.1128 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0874 - val_loss: 0.1121 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0878 - val_loss: 0.1116 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0887 - val_loss: 0.1114 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0873 - val_loss: 0.1117 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0871 - val_loss: 0.1119 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0887 - val_loss: 0.1120 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0887 - val_loss: 0.1121 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0881 - val_loss: 0.1122 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0885 - val_loss: 0.1122 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0882 - val_loss: 0.1122 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0878 - val_loss: 0.1122 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0876 - val_loss: 0.1122 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0890 - val_loss: 0.1122 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0892 - val_loss: 0.1122 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0885 - val_loss: 0.1122 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0882 - val_loss: 0.1122 - lr: 1.5073e-07
Epoch 1/100

2023-11-27 18:11:34.910088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:34.910545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:34.911187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:34.967278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:34.967701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:34.968050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:35.058355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:35.058821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:35.059273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:35.129086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:35.129886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:35.130322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:35.377622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:35.378241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:35.378688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:35.440450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:35.440981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:35.441425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 25ms/step - loss: 0.2300 - val_loss: 0.2011 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1303

2023-11-27 18:11:36.052379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:36.052884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:36.053311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:36.114646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:36.115086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:36.115467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 5ms/step - loss: 0.1633 - val_loss: 0.1692 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1586 - val_loss: 0.1635 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1475 - val_loss: 0.1603 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1375 - val_loss: 0.1460 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1309 - val_loss: 0.1384 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1278 - val_loss: 0.1301 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1237 - val_loss: 0.1232 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1186 - val_loss: 0.1144 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1156 - val_loss: 0.1071 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1090 - val_loss: 0.1033 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1049 - val_loss: 0.0962 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1016 - val_loss: 0.0942 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0974 - val_loss: 0.0984 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0909 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0880 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0912 - val_loss: 0.0895 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0912 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0862 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0867 - val_loss: 0.0869 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0836 - val_loss: 0.0850 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0842 - val_loss: 0.0843 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0839 - val_loss: 0.0832 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0829 - val_loss: 0.0834 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0827 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.0842 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0815 - val_loss: 0.0840 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0818 - val_loss: 0.0855 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0825 - val_loss: 0.0837 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0833 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0825 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0824 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0825 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.0828 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0807 - val_loss: 0.0828 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0811 - val_loss: 0.0829 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0831 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0832 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.0832 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0805 - val_loss: 0.0833 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0832 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.0832 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0814 - val_loss: 0.0832 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0811 - val_loss: 0.0832 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0832 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0803 - val_loss: 0.0832 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0808 - val_loss: 0.0832 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0832 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0832 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0812 - val_loss: 0.0832 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0808 - val_loss: 0.0832 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0803 - val_loss: 0.0832 - lr: 1.6702e-08
Epoch 1/100

2023-11-27 18:11:39.870684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:39.871341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:39.871834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:39.925937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:39.926342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:39.926715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:40.011911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:40.012355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:40.012802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:40.083864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:40.084695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:40.085251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:40.340862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:40.342130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:40.342957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:40.408264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:40.408751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:40.409193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.1755 - val_loss: 0.1576 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1761

2023-11-27 18:11:41.053355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:41.054180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:41.054688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:41.120955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:41.121534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:41.122064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1575 - val_loss: 0.1485 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1441 - val_loss: 0.1450 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1382 - val_loss: 0.1429 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1329 - val_loss: 0.1410 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1289 - val_loss: 0.1308 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1212 - val_loss: 0.1282 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1187 - val_loss: 0.1327 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1200 - val_loss: 0.1192 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1119 - val_loss: 0.1196 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1094 - val_loss: 0.1122 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1051 - val_loss: 0.1139 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1032 - val_loss: 0.1104 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1021 - val_loss: 0.1038 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.1018 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.1024 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.0988 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0969 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0975 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.0928 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0917 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0886 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0889 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0867 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0857 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0844 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.0833 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0845 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0828 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0821 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0830 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0830 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0823 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0823 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0820 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0800 - val_loss: 0.0817 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0817 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0816 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0816 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0816 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0816 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0816 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0816 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0816 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0816 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0816 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0816 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0816 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0816 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0816 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0816 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0816 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0816 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0816 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0816 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0816 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0816 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0816 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0816 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0816 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0816 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0816 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0816 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0816 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0816 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0816 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0816 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0816 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0816 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0816 - lr: 7.5826e-13
Epoch 1/100

2023-11-27 18:11:47.096204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.096608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.097190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:47.147625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.147990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.148328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:47.228041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.228531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.228946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:47.288708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.289165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.289575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:47.521113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.521571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.522008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:47.579892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:47.580368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:47.580778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 2s 16ms/step - loss: 0.1822 - val_loss: 0.1586 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1899

2023-11-27 18:11:48.672237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:48.672852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:48.673422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:48.735237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:48.735611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:48.735994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1599 - val_loss: 0.1490 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1439 - val_loss: 0.1408 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1329 - val_loss: 0.1336 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1237 - val_loss: 0.1276 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1191 - val_loss: 0.1244 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1156 - val_loss: 0.1231 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1119 - val_loss: 0.1236 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 4ms/step - loss: 0.1109 - val_loss: 0.1247 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1233 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1048 - val_loss: 0.1187 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1000 - val_loss: 0.1146 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0953 - val_loss: 0.1118 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0920 - val_loss: 0.1100 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.1076 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.1061 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.1028 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1014 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.0988 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.0972 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0961 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0943 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0938 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0934 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0927 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0924 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0922 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0921 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0918 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0916 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.0916 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0916 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0915 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0915 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0914 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0914 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0914 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0914 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0913 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0913 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0913 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0913 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0913 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0913 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0913 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0913 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0913 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0913 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0913 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0913 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0913 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0913 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0913 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0913 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0913 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0913 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0913 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0913 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0913 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0913 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0913 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0913 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0913 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0913 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0913 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0913 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0913 - lr: 1.8698e-13
Average Validation Loss: 0.10275690704584121
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:11:56.412537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.413724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.414521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:56.472311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.472721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.473157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:56.560069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.560551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.561005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:56.626137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.626763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.627224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:56.878026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.878609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.879037: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:56.938720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:56.939176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:56.939591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 19ms/step - loss: 0.1675 - val_loss: 0.1284 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0604

2023-11-27 18:11:57.538767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:57.539257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:57.539916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:11:57.600618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:11:57.601043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:11:57.601429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1091 - val_loss: 0.1326 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1151 - val_loss: 0.1250 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1035 - val_loss: 0.1249 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1072 - val_loss: 0.1209 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1003 - val_loss: 0.1204 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1030 - val_loss: 0.1174 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0935 - val_loss: 0.1163 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0960 - val_loss: 0.1120 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0877 - val_loss: 0.1144 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.1033 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.1000 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0532 - val_loss: 0.1174 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.1019 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.1027 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.1036 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0911 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.1045 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0903 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.1000 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0921 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0975 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0423 - val_loss: 0.0949 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0973 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0958 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0958 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0936 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0974 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0408 - val_loss: 0.0964 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0408 - val_loss: 0.0944 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0950 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0943 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0411 - val_loss: 0.0952 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0954 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0949 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0953 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0417 - val_loss: 0.0954 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0953 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0954 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:12:00.516090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.516485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.517135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:00.568582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.568999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.569361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:00.650261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.650743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.651158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:00.710584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.711022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.711430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:00.894249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.894722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.895295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:00.953889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:00.954313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:00.954724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1334 - val_loss: 0.0725 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0761

2023-11-27 18:12:01.462649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:01.463203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:01.463835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:01.524775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:01.525215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:01.525586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1235 - val_loss: 0.0754 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1156 - val_loss: 0.0770 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1147 - val_loss: 0.0625 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1088 - val_loss: 0.0850 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1067 - val_loss: 0.0592 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1055 - val_loss: 0.0739 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0999 - val_loss: 0.0679 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0975 - val_loss: 0.0694 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0950 - val_loss: 0.0811 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0901 - val_loss: 0.0759 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0864 - val_loss: 0.0807 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0838 - val_loss: 0.0807 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0797 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0804 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0743 - val_loss: 0.0826 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0701 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0806 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0650 - val_loss: 0.0806 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0641 - val_loss: 0.0777 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0728 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0715 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0717 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0691 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0713 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0714 - lr: 1.1080e-04
Epoch 1/100

2023-11-27 18:12:03.956648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:03.957158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:03.957661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:04.008570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:04.008946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:04.009290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:04.090663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:04.091136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:04.091553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:04.150782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:04.151256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:04.151700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:04.390851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:04.391779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:04.392381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:04.455681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:04.456103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:04.456543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1134 - val_loss: 0.1098 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0779

2023-11-27 18:12:05.178287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:05.178979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:05.179525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:05.247143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:05.247635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:05.248068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1081 - val_loss: 0.1020 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.0958 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0995 - val_loss: 0.0916 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0970 - val_loss: 0.0904 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0917 - val_loss: 0.0823 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0938 - val_loss: 0.0848 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0874 - val_loss: 0.0799 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0830 - val_loss: 0.0732 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0866 - val_loss: 0.0761 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0753 - val_loss: 0.0636 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0684 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0569 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0555 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0544 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0494 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0514 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0478 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0493 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0490 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0484 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0474 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0464 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0451 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0442 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0442 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0440 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0444 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0441 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0445 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0452 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0453 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0451 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0454 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0456 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0458 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0459 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0460 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0460 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0460 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0461 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0460 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0460 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0461 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0460 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0461 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0461 - lr: 1.5073e-07
Epoch 1/100

2023-11-27 18:12:12.953328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:12.953770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:12.954227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:13.005800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:13.006152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:13.006502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:13.087480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:13.088015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:13.088469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:13.148434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:13.148896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:13.149323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:13.383080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:13.383548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:13.384094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:13.441361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:13.441816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:13.442233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1179 - val_loss: 0.1073 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.0892

2023-11-27 18:12:14.229377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:14.229927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:14.230650: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:14.293520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:14.293981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:14.294368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1084 - val_loss: 0.1002 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1025 - val_loss: 0.0948 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0986 - val_loss: 0.0959 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0933 - val_loss: 0.0983 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0899 - val_loss: 0.0898 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0860 - val_loss: 0.0860 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0827 - val_loss: 0.0828 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0848 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0803 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0770 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0782 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0780 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0730 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0748 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0711 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0717 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0711 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0695 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0718 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0688 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0674 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0507 - val_loss: 0.0667 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0669 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0644 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0623 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0599 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0567 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0556 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0551 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0545 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0542 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0540 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0539 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0538 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0538 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0538 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0537 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0537 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0537 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0537 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0537 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0537 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0537 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0537 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0537 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0537 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0537 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0537 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0537 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0537 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0537 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0537 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0537 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0537 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0537 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0537 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0537 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0537 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0537 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0537 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0537 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0537 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0537 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0537 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0537 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0537 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0537 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0537 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0537 - lr: 3.1068e-16
Epoch 82/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0537 - lr: 1.3960e-16
Epoch 1/100

2023-11-27 18:12:30.923606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:30.924183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:30.924527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:30.977177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:30.977587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:30.977940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:31.056935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:31.057427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:31.057839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:31.118086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:31.118548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:31.118960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:31.367343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:31.367817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:31.368254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:31.427459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:31.427901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:31.428329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1212 - val_loss: 0.1024 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0867

2023-11-27 18:12:32.234837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:32.235323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:32.235903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:32.296684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:32.297142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:32.297563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1066 - val_loss: 0.0940 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.0972 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.0983 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0886 - val_loss: 0.0908 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0854 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0822 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0770 - val_loss: 0.0810 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0738 - val_loss: 0.0779 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0750 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0716 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0679 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0569 - val_loss: 0.0666 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0651 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0626 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0629 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0634 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0623 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0613 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0604 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0596 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0581 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0572 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0564 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0432 - val_loss: 0.0562 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0422 - val_loss: 0.0561 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0425 - val_loss: 0.0566 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0561 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0424 - val_loss: 0.0564 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0554 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0549 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0551 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0546 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0546 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0408 - val_loss: 0.0546 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0546 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0546 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0546 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0545 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0545 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0545 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0545 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0545 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0545 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0545 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0545 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0408 - val_loss: 0.0545 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0545 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0545 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0545 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0545 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0545 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0545 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0545 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0545 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0545 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0545 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0545 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0545 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0545 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0545 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0405 - val_loss: 0.0545 - lr: 1.3816e-12
Average Validation Loss: 0.060347387194633485
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:12:48.956472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:48.957115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:48.957733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:49.010245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:49.010635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:49.011000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:49.094441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:49.094971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:49.095429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:49.157378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:49.157860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:49.158365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:49.404626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:49.405284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:49.405749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:49.463986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:49.464454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:49.464871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1424 - val_loss: 0.1320 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0602

2023-11-27 18:12:50.047984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:50.048649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:50.049101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:50.109507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:50.109921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:50.110290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1132 - val_loss: 0.1361 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1141 - val_loss: 0.1346 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1274 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1041 - val_loss: 0.1202 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.1154 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.1145 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0837 - val_loss: 0.1080 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.1111 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0995 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.1082 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.1083 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.1079 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.1004 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.1150 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0969 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0518 - val_loss: 0.1077 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0505 - val_loss: 0.1012 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.1014 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.1043 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.1006 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0974 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.1022 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.1029 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.1006 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0996 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.1010 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.1016 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.1012 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.1011 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.1007 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.1008 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.1009 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.1010 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.1010 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0481 - val_loss: 0.1010 - lr: 8.2297e-06
Epoch 1/100

2023-11-27 18:12:51.887053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:51.887727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:51.888160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:51.943084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:51.943447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:51.943810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:52.029604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.030052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.030478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:52.094416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.095054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.095539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:52.287742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.288214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.288624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:52.348935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.349591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.350060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.1550 - val_loss: 0.0889 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0561

2023-11-27 18:12:52.816720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.817265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.817923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:52.878380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:52.878801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:52.879200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 3ms/step - loss: 0.1224 - val_loss: 0.0869 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1133 - val_loss: 0.0802 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1063 - val_loss: 0.0731 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1007 - val_loss: 0.0703 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.0703 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0909 - val_loss: 0.0682 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0844 - val_loss: 0.0702 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.0704 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0667 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0583 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0517 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0539 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0620 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0745 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0651 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0626 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0564 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0681 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0578 - val_loss: 0.0673 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0626 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0644 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0618 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0628 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0638 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0645 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0649 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0619 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0609 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0631 - lr: 2.7324e-05
Epoch 1/100

2023-11-27 18:12:54.789775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:54.790293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:54.790706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:54.841585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:54.841980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:54.842328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:54.923128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:54.923633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:54.924078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:54.983203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:54.983654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:54.984074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:55.225449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:55.225933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:55.226617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:55.287640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:55.288120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:55.288589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 2s 14ms/step - loss: 0.1346 - val_loss: 0.1232 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0653

2023-11-27 18:12:56.450680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:56.451424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:56.451906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:12:56.513891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:12:56.514309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:12:56.514696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1092 - val_loss: 0.1169 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1021 - val_loss: 0.1028 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0994 - val_loss: 0.0944 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0937 - val_loss: 0.0876 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0916 - val_loss: 0.0848 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0911 - val_loss: 0.0819 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0893 - val_loss: 0.0795 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0868 - val_loss: 0.0777 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0833 - val_loss: 0.0746 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0842 - val_loss: 0.0743 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0705 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.0689 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0666 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0674 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0675 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0665 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0619 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0624 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0633 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0642 - val_loss: 0.0648 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0650 - val_loss: 0.0668 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0624 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0647 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0660 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0648 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0630 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0643 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0649 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0642 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0642 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0645 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0641 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0643 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0642 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0646 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0647 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0647 - lr: 4.5166e-06
Epoch 1/100

2023-11-27 18:13:00.466106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.466622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:00.466963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:00.525271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.525682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:00.526035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:00.621110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.621626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:00.622211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:00.689694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.690433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:00.690952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:00.938344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.938893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:00.939324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:00.999283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:00.999775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:01.000194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1313 - val_loss: 0.1103 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0773

2023-11-27 18:13:01.676337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:01.676804: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:01.677478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:01.738278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:01.738737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:01.739120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1099 - val_loss: 0.1086 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1027 - val_loss: 0.1220 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0987 - val_loss: 0.1227 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0944 - val_loss: 0.1221 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0891 - val_loss: 0.1059 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.0933 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0748 - val_loss: 0.0881 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.0902 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0855 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0925 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0893 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0970 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.1087 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.1081 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0901 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0916 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.0832 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0792 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0755 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0716 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0672 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0664 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0629 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.0628 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0613 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0542 - val_loss: 0.0603 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0607 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0532 - val_loss: 0.0592 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0591 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0590 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0588 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0588 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0588 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0587 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0586 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0586 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0586 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0586 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0586 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0529 - val_loss: 0.0586 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0586 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0586 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0586 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0586 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0586 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0586 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0586 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0586 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0586 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0586 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0586 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0586 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0586 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0586 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0586 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0586 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0586 - lr: 1.6788e-10
Epoch 1/100

2023-11-27 18:13:09.671358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:09.671784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:09.672365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:09.725243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:09.725621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:09.725925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:09.807196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:09.807667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:09.808024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:09.869924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:09.870540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:09.871066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:10.117526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:10.118102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:10.118553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:10.177321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:10.177803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:10.178270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1218 - val_loss: 0.1057 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0756

2023-11-27 18:13:10.891926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:10.892408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:10.893040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:10.954459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:10.954931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:10.955359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1058 - val_loss: 0.0970 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0876 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0890 - val_loss: 0.0847 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0828 - val_loss: 0.0820 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.0818 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.0801 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0785 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0772 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0762 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0652 - val_loss: 0.0756 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0735 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0715 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0696 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0674 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0657 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0640 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0630 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0619 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0593 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0579 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0578 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0576 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0578 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0575 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0577 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0561 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0556 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0553 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0548 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0548 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0546 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0545 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0545 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0545 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0545 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0447 - val_loss: 0.0545 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0544 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0544 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0544 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0544 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0544 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0544 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0544 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0544 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0544 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0544 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0544 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0544 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0544 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0544 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0544 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0544 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0544 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0544 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0544 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0544 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0544 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0544 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0544 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0544 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0544 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0544 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0544 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0544 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0544 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0544 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0544 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0544 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0544 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0544 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0544 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0544 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0544 - lr: 2.2897e-14
Average Validation Loss: 0.06469340845942498
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:13:22.623084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:22.623750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:22.624383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:22.683519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:22.683940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:22.684285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:22.770103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:22.770584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:22.771024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:22.833677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:22.834321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:22.834771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:23.078911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:23.079523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:23.080164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:23.150547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:23.151158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:23.151607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 74ms/step - loss: 0.1561 - val_loss: 0.1431 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0862

2023-11-27 18:13:23.741313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:23.742661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:23.743271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:23.812256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:23.812737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:23.813123: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1202 - val_loss: 0.1285 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1062 - val_loss: 0.1318 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1072 - val_loss: 0.1362 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1089 - val_loss: 0.1378 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1122 - val_loss: 0.1357 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1093 - val_loss: 0.1306 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1056 - val_loss: 0.1242 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1006 - val_loss: 0.1180 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0978 - val_loss: 0.1134 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0924 - val_loss: 0.1114 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.1113 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0835 - val_loss: 0.1103 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0838 - val_loss: 0.1085 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0806 - val_loss: 0.1060 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0756 - val_loss: 0.1051 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0710 - val_loss: 0.1069 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0704 - val_loss: 0.1072 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0661 - val_loss: 0.1052 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0673 - val_loss: 0.1027 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0650 - val_loss: 0.1018 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0625 - val_loss: 0.1015 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0636 - val_loss: 0.1023 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0602 - val_loss: 0.1035 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0593 - val_loss: 0.1035 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0598 - val_loss: 0.1033 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0583 - val_loss: 0.1033 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0600 - val_loss: 0.1032 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0598 - val_loss: 0.1028 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0582 - val_loss: 0.1028 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0583 - val_loss: 0.1026 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0598 - val_loss: 0.1025 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0596 - val_loss: 0.1024 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0599 - val_loss: 0.1024 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0577 - val_loss: 0.1023 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0598 - val_loss: 0.1023 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0593 - val_loss: 0.1023 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0595 - val_loss: 0.1023 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0595 - val_loss: 0.1023 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0592 - val_loss: 0.1023 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0597 - val_loss: 0.1023 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0587 - val_loss: 0.1023 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:13:25.462087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.462571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.463018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:25.518640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.518993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.519344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:25.605434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.605906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.606322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:25.667281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.667788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.668202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:25.915254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.915720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.916182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:25.976167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:25.976672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:25.977101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1794 - val_loss: 0.1358 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0954

2023-11-27 18:13:26.568080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:26.568550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:26.569231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:26.629961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:26.630385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:26.630762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1384 - val_loss: 0.0987 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1362 - val_loss: 0.0933 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1313 - val_loss: 0.0923 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1281 - val_loss: 0.0929 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1231 - val_loss: 0.0938 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1156 - val_loss: 0.0865 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1106 - val_loss: 0.0765 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1062 - val_loss: 0.0764 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1018 - val_loss: 0.0845 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0943 - val_loss: 0.0817 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.0898 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0846 - val_loss: 0.0835 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0781 - val_loss: 0.0911 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0750 - val_loss: 0.0854 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0719 - val_loss: 0.0899 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0691 - val_loss: 0.0852 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0695 - val_loss: 0.0861 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0676 - val_loss: 0.0839 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0661 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0644 - val_loss: 0.0838 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0645 - val_loss: 0.0793 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0631 - val_loss: 0.0809 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0651 - val_loss: 0.0787 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0626 - val_loss: 0.0775 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0612 - val_loss: 0.0776 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0620 - val_loss: 0.0773 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0620 - val_loss: 0.0795 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0627 - val_loss: 0.0808 - lr: 6.0810e-05
Epoch 1/100

2023-11-27 18:13:28.264042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.264523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.265050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:28.317445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.317837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.318199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:28.398727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.399192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.399618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:28.458724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.459184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.459593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:28.698568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.699150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.699550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:28.763189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:28.763678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:28.764288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 25ms/step - loss: 0.1764 - val_loss: 0.1436 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.0844

2023-11-27 18:13:29.402602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:29.403128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:29.403838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:29.465080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:29.465527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:29.465941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1188 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1088 - val_loss: 0.1198 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1060 - val_loss: 0.1178 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.1065 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.0982 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0913 - val_loss: 0.0927 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.0890 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0868 - val_loss: 0.0875 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0814 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0788 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0760 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0734 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0745 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0716 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0732 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0712 - val_loss: 0.0713 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0707 - val_loss: 0.0724 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0689 - val_loss: 0.0687 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.0702 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0663 - val_loss: 0.0671 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0674 - val_loss: 0.0695 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0653 - val_loss: 0.0682 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0684 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0634 - val_loss: 0.0697 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0685 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0675 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0676 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0635 - val_loss: 0.0682 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0686 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0682 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0640 - val_loss: 0.0682 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0627 - val_loss: 0.0681 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0680 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0679 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0638 - val_loss: 0.0678 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0633 - val_loss: 0.0678 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0629 - val_loss: 0.0678 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0678 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0630 - val_loss: 0.0678 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:13:32.481345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.481755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.482212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:32.534578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.534971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.535378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:32.614734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.615184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.615610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:32.675894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.676347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.676768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:32.910004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.910469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.910936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:32.968586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:32.969046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:32.969472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.1418 - val_loss: 0.1131 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1360

2023-11-27 18:13:33.597073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:33.597565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:33.597994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:33.661309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:33.661756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:33.662133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1220 - val_loss: 0.1055 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1086 - val_loss: 0.0983 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0953 - val_loss: 0.0950 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.1068 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0981 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.0884 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0871 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0898 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0848 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0768 - val_loss: 0.0795 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0762 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0756 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0742 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0688 - val_loss: 0.0693 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0669 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0648 - val_loss: 0.0660 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0629 - val_loss: 0.0656 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0630 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0621 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0587 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0590 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0575 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0564 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0559 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0550 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0550 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0553 - val_loss: 0.0552 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0548 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0542 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0541 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0543 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0543 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0543 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0543 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0542 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0541 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0541 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0541 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0540 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0540 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0540 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0540 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0540 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0540 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0540 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0550 - val_loss: 0.0540 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0540 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0540 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0540 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0540 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0540 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0559 - val_loss: 0.0540 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0540 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0540 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0540 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0540 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0540 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0552 - val_loss: 0.0540 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0540 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0540 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0540 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0540 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0540 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0540 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0540 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0540 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0540 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0540 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0540 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0548 - val_loss: 0.0540 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0540 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0540 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0540 - lr: 4.6110e-14
Epoch 1/100

2023-11-27 18:13:40.354049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.354482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.354962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:40.406666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.407132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.407577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:40.493482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.493932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.494373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:40.560167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.560821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.561304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:40.804515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.805136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.805774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:40.864431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:40.864895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:40.865317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 17ms/step - loss: 0.1388 - val_loss: 0.1119 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1443

2023-11-27 18:13:41.526702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:41.527230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:41.527918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:41.593791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:41.594323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:41.594873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1145 - val_loss: 0.1056 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0998 - val_loss: 0.1021 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.1004 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.1022 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0962 - val_loss: 0.1038 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0994 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0863 - val_loss: 0.0981 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0983 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0980 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0946 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0926 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0910 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0891 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0876 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0850 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0837 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0811 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0783 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0754 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0725 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0712 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0697 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0691 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0679 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0675 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0671 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0668 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0667 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0665 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0665 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0664 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0663 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0662 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0662 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0661 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0661 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0661 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0661 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0661 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0661 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0661 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0661 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0661 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0661 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0661 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0661 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0661 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0661 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0661 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0661 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0661 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0661 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0661 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0661 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0661 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0661 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0661 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0661 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0661 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0661 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0661 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0661 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0661 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0661 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0661 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0661 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0661 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0661 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0661 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0661 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0661 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0661 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0661 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0661 - lr: 5.6464e-15
Average Validation Loss: 0.07302865907549858
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:13:50.047765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:50.048397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:50.048929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:50.102041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:50.102434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:50.102772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:50.183563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:50.184066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:50.184501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:50.244641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:50.245138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:50.245557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:51.011143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:51.011825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:51.012234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:51.075222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:51.075741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:51.076126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 2s 20ms/step - loss: 0.1102 - val_loss: 0.1241 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0738

2023-11-27 18:13:51.700961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:51.701615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:51.702817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:51.763784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:51.764218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:51.764601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1052 - val_loss: 0.1250 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1049 - val_loss: 0.1169 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.1157 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.1194 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0970 - val_loss: 0.1156 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0878 - val_loss: 0.1200 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0952 - val_loss: 0.1122 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0807 - val_loss: 0.1147 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0750 - val_loss: 0.1194 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.1142 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1060 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.1047 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.1054 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0982 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.1039 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.1011 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0966 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.1052 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0969 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.1027 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0997 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0983 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0972 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.1006 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.1006 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0981 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0983 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0376 - val_loss: 0.1027 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.1019 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0996 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0996 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.1002 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0989 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0992 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0997 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.1001 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.1006 - lr: 4.5166e-06
Epoch 1/100

2023-11-27 18:13:54.622005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:54.622462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:54.622800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:54.674941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:54.675350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:54.675692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:54.754043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:54.754495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:54.754917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:54.813741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:54.814188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:54.814606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:54.992465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:54.992907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:54.993460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:55.049371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:55.049811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:55.050222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1362 - val_loss: 0.0710 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0728

2023-11-27 18:13:55.562097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:55.562783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:55.563183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:55.628258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:55.628719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:55.629254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1230 - val_loss: 0.0726 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1155 - val_loss: 0.0681 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.0627 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1066 - val_loss: 0.0779 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1027 - val_loss: 0.0569 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1041 - val_loss: 0.0813 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0989 - val_loss: 0.0594 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0977 - val_loss: 0.0729 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0924 - val_loss: 0.0718 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0888 - val_loss: 0.0704 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0829 - val_loss: 0.0705 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0687 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0644 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0615 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0630 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0613 - val_loss: 0.0605 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0579 - val_loss: 0.0621 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0575 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0537 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0529 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0541 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0574 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0613 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0613 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0605 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0622 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0617 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0634 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0613 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0613 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0619 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0616 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0615 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0620 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0618 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0620 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0621 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0621 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0622 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:13:59.409353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.409767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.410414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:59.463825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.464253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.464607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:59.547599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.548147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.548631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:59.609730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.610250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.610726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:59.855136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.855813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.856275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:13:59.924573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:13:59.925024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:13:59.925432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1181 - val_loss: 0.1026 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0754

2023-11-27 18:14:00.650043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:00.650660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:00.651304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:00.716566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:00.717064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:00.717456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1009 - val_loss: 0.0940 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0983 - val_loss: 0.0921 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0967 - val_loss: 0.0895 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0962 - val_loss: 0.0873 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0929 - val_loss: 0.0865 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0915 - val_loss: 0.0845 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0882 - val_loss: 0.0835 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0851 - val_loss: 0.0806 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0789 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0798 - val_loss: 0.0740 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0722 - val_loss: 0.0646 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0704 - val_loss: 0.0606 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0610 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0562 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0550 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0535 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0522 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0522 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0521 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0511 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0502 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0495 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0490 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0491 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0502 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0508 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0472 - val_loss: 0.0510 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0526 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0516 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0524 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0519 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0521 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0521 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0520 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0523 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0523 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0522 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0522 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0522 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0523 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0522 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0522 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:14:07.739023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:07.739708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:07.740018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:07.792320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:07.792685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:07.793023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:07.873413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:07.873883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:07.874316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:07.934191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:07.934690: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:07.935164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:08.166799: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:08.167266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:08.167784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:08.226654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:08.227140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:08.227581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1044 - val_loss: 0.1077 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1287

2023-11-27 18:14:08.999675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:09.000221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:09.000985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:09.066703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:09.067179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:09.067579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.0994 - val_loss: 0.0958 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0807 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0861 - val_loss: 0.0845 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0853 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0755 - val_loss: 0.0818 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0859 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0880 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0902 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0940 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0728 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0679 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0637 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0603 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0617 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0590 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0596 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0603 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0572 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0592 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0588 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0581 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0566 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0551 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0546 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0525 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0476 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0465 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0476 - val_loss: 0.0452 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0444 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0436 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0432 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0429 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0428 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0427 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0427 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0426 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0445 - val_loss: 0.0426 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0426 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0425 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0425 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0425 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0425 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0425 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0425 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0434 - val_loss: 0.0425 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0425 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0425 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0425 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0425 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0425 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0432 - val_loss: 0.0425 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0425 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0425 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0425 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0425 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0425 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0432 - val_loss: 0.0425 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0425 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0425 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0425 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0425 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0425 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0425 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0425 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0425 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0425 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0425 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0445 - val_loss: 0.0425 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0425 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0425 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0425 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0425 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0425 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0425 - lr: 6.9144e-16
Epoch 1/100

2023-11-27 18:14:26.034609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.035134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.035552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:26.095175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.095683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.096143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:26.189798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.190902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.191648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:26.263737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.264378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.265089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:26.530860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.531437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.531879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:26.596165: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:26.596748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:26.597210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 2s 7ms/step - loss: 0.1151 - val_loss: 0.0939 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0525

2023-11-27 18:14:27.478533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:27.479029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:27.479862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:27.550724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:27.551319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:27.551723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.0984 - val_loss: 0.0877 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0847 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0838 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0759 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0763 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0758 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0726 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0701 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0678 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0679 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0676 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0672 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0646 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0649 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0626 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0620 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0623 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0631 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0599 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0579 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0575 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0397 - val_loss: 0.0564 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0389 - val_loss: 0.0560 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0392 - val_loss: 0.0559 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0554 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0555 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0388 - val_loss: 0.0553 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0550 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0385 - val_loss: 0.0546 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0382 - val_loss: 0.0543 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0540 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0539 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0538 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0538 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0538 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0381 - val_loss: 0.0538 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0538 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0537 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0537 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0537 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0537 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0537 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0368 - val_loss: 0.0537 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0537 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0537 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0537 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0537 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0537 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0537 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0537 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0537 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0537 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0537 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0537 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0537 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0537 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0537 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0537 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0537 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0537 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0537 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0537 - lr: 1.3960e-16
Average Validation Loss: 0.058939972519874574
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:14:48.323023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.323520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.324026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:48.374756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.375125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.375474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:48.456062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.456551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.456969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:48.516342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.516788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.517373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:48.753910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.754396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.754988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:48.818857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:48.819369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:48.819868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1369 - val_loss: 0.1251 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0543

2023-11-27 18:14:49.403465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:49.403936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:49.404579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:49.464864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:49.465285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:49.465668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.0949 - val_loss: 0.1313 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0990 - val_loss: 0.1287 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0970 - val_loss: 0.1178 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0936 - val_loss: 0.1128 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1166 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.1136 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0714 - val_loss: 0.1080 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.1113 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0984 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.1153 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0519 - val_loss: 0.1011 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0512 - val_loss: 0.1033 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.1083 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0914 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.1023 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0975 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.1022 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0990 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0417 - val_loss: 0.0965 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.1034 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0943 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0417 - val_loss: 0.0967 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.1018 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0992 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0949 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0971 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0993 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0992 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0975 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0415 - val_loss: 0.0965 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0973 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0984 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0996 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0420 - val_loss: 0.0995 - lr: 1.1109e-05
Epoch 1/100

2023-11-27 18:14:51.174944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.175344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.175994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:51.228823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.229162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.229503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:51.310716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.311339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.311899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:51.373085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.373574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.373989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:51.558899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.559366: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.559827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:51.616953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:51.617421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:51.617847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1299 - val_loss: 0.0769 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0583

2023-11-27 18:14:52.096421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:52.097612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:52.098112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:52.163103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:52.163513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:52.163941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1116 - val_loss: 0.0718 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1055 - val_loss: 0.0694 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0932 - val_loss: 0.0680 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0896 - val_loss: 0.0669 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0860 - val_loss: 0.0713 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0753 - val_loss: 0.0821 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0752 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0743 - val_loss: 0.0781 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0755 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0723 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0725 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0680 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0563 - val_loss: 0.0702 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0702 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0662 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0659 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0647 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0606 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0649 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0636 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0652 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0634 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0618 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0634 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0635 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0622 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0635 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0644 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0635 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0638 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0638 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0468 - val_loss: 0.0638 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0639 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0467 - val_loss: 0.0639 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0639 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0639 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0638 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:14:54.664089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:54.664511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:54.665130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:54.718928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:54.719362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:54.719815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:54.804357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:54.804816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:54.805232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:54.865503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:54.866291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:54.866897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:55.121225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:55.122362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:55.122953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:55.188132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:55.188638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:55.189078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.1045 - val_loss: 0.1028 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0542

2023-11-27 18:14:55.896105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:55.896943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:55.897370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:14:55.963432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:14:55.963918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:14:55.964320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.0931 - val_loss: 0.0934 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0894 - val_loss: 0.0819 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.0726 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0809 - val_loss: 0.0676 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0670 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0751 - val_loss: 0.0653 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0643 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0616 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0606 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0597 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.0603 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0574 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0523 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0498 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0486 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0471 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0454 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0452 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0447 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0473 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0511 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0519 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0474 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0485 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0473 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.0484 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0469 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0465 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0474 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0467 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0464 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0466 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0467 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0468 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0468 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0468 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0467 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0467 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0468 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:15:00.241717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:00.242178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:00.242750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:00.298277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:00.298743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:00.299112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:00.922812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:00.923614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:00.924047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:00.987820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:00.988290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:00.988732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:01.247137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:01.247769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:01.248210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:01.308365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:01.308829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:01.309246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 2s 13ms/step - loss: 0.1297 - val_loss: 0.1057 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0684

2023-11-27 18:15:02.022405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:02.023013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:02.023400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:02.085164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:02.085628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:02.086041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1046 - val_loss: 0.0970 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0909 - val_loss: 0.1037 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0888 - val_loss: 0.1053 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0837 - val_loss: 0.0973 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0902 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0755 - val_loss: 0.0863 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0784 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0764 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0645 - val_loss: 0.0809 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0868 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0967 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0920 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0678 - val_loss: 0.0891 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0833 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0865 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.0807 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0789 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0754 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0722 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0692 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0667 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0651 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0644 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0626 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0627 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0624 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0615 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0518 - val_loss: 0.0611 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0612 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0608 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0602 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0600 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0599 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0600 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0600 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0600 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0600 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0600 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0503 - val_loss: 0.0599 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0599 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0599 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0599 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0599 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0599 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0599 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0599 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0599 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0599 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0599 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0599 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0599 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0599 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0599 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0599 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0599 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0599 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0599 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0599 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0599 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0599 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0599 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0599 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0599 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0516 - val_loss: 0.0599 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0599 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0599 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0599 - lr: 4.6110e-14
Epoch 1/100

2023-11-27 18:15:11.675157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:11.675722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:11.676057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:11.728899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:11.729286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:11.729632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:11.811014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:11.811436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:11.811943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:11.871943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:11.872401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:11.872905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:12.121121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:12.121599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:12.122300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:12.181734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:12.182201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:12.182665: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1219 - val_loss: 0.0983 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0662

2023-11-27 18:15:12.886176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:12.886743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:12.887091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:12.951765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:12.952142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:12.952503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1016 - val_loss: 0.0882 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0832 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0828 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0791 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.0789 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0772 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0768 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0777 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0821 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0761 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0761 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0726 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0717 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0717 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0710 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0703 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0687 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0681 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0676 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0662 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0659 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0423 - val_loss: 0.0650 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0427 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0416 - val_loss: 0.0635 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0630 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0414 - val_loss: 0.0625 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0411 - val_loss: 0.0621 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0412 - val_loss: 0.0618 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0616 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0616 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0615 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0614 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0614 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0613 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0613 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0613 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0613 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0403 - val_loss: 0.0613 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0613 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0613 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0613 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0613 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0613 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0612 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0612 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0612 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0612 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0612 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0612 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0612 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0407 - val_loss: 0.0612 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0401 - val_loss: 0.0612 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0612 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0612 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0404 - val_loss: 0.0612 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0612 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0612 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0612 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0405 - val_loss: 0.0612 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0612 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0408 - val_loss: 0.0612 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0612 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0612 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0612 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0612 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0612 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0612 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0612 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0612 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0612 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0612 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0389 - val_loss: 0.0612 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0612 - lr: 2.2897e-14
Average Validation Loss: 0.06359291672706605
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:15:24.561426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:24.561904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:24.562294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:24.616448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:24.616865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:24.617275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:24.700377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:24.701250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:24.702028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:24.771910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:24.772469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:24.772905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:25.007800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:25.008615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:25.009138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:25.069274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:25.069750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:25.070162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 65ms/step - loss: 0.2227 - val_loss: 0.1881 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1128

2023-11-27 18:15:25.635398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:25.635885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:25.636307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:25.695703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:25.696121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:25.696512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 10ms/step - loss: 0.1576 - val_loss: 0.1426 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1159 - val_loss: 0.1257 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1020 - val_loss: 0.1283 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1028 - val_loss: 0.1330 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1049 - val_loss: 0.1362 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1046 - val_loss: 0.1353 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1309 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1005 - val_loss: 0.1242 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0919 - val_loss: 0.1165 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0880 - val_loss: 0.1118 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0849 - val_loss: 0.1103 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0821 - val_loss: 0.1109 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0797 - val_loss: 0.1112 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0803 - val_loss: 0.1104 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.1089 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.1072 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0708 - val_loss: 0.1059 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0703 - val_loss: 0.1053 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0688 - val_loss: 0.1051 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0662 - val_loss: 0.1033 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0664 - val_loss: 0.1019 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0658 - val_loss: 0.1015 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0633 - val_loss: 0.1013 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0624 - val_loss: 0.1013 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0628 - val_loss: 0.1010 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0628 - val_loss: 0.1005 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0606 - val_loss: 0.1001 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0598 - val_loss: 0.1000 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0614 - val_loss: 0.0998 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0607 - val_loss: 0.0997 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0612 - val_loss: 0.0996 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0616 - val_loss: 0.0995 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0610 - val_loss: 0.0994 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0606 - val_loss: 0.0994 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0581 - val_loss: 0.0994 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0583 - val_loss: 0.0993 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0611 - val_loss: 0.0993 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0591 - val_loss: 0.0993 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0598 - val_loss: 0.0993 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0615 - val_loss: 0.0993 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0620 - val_loss: 0.0993 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0572 - val_loss: 0.0993 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0606 - val_loss: 0.0993 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0582 - val_loss: 0.0993 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0594 - val_loss: 0.0993 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0575 - val_loss: 0.0993 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0617 - val_loss: 0.0993 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0612 - val_loss: 0.0993 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0620 - val_loss: 0.0993 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0619 - val_loss: 0.0993 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0598 - val_loss: 0.0993 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0619 - val_loss: 0.0993 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0572 - val_loss: 0.0993 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0611 - val_loss: 0.0993 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0609 - val_loss: 0.0993 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0599 - val_loss: 0.0993 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0591 - val_loss: 0.0993 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0581 - val_loss: 0.0993 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0605 - val_loss: 0.0993 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0622 - val_loss: 0.0993 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0611 - val_loss: 0.0993 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0611 - val_loss: 0.0993 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0607 - val_loss: 0.0993 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0604 - val_loss: 0.0993 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0608 - val_loss: 0.0993 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0605 - val_loss: 0.0993 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0579 - val_loss: 0.0993 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0586 - val_loss: 0.0993 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0594 - val_loss: 0.0993 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0601 - val_loss: 0.0993 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0576 - val_loss: 0.0993 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0601 - val_loss: 0.0993 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0608 - val_loss: 0.0993 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0603 - val_loss: 0.0993 - lr: 2.2897e-14
Epoch 1/100

2023-11-27 18:15:28.447176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.447702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.448061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:28.501967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.502312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.502634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:28.589987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.590438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.590865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:28.653111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.653775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.654245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:28.916973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.917906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.918399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:28.983885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:28.984426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:28.984979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1873 - val_loss: 0.1206 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0830

2023-11-27 18:15:29.587176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:29.587676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:29.588347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:29.648814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:29.649299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:29.649721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1183 - val_loss: 0.0756 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1165 - val_loss: 0.0717 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1135 - val_loss: 0.0713 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1059 - val_loss: 0.0730 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1069 - val_loss: 0.0696 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1034 - val_loss: 0.0669 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0999 - val_loss: 0.0644 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0972 - val_loss: 0.0645 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0933 - val_loss: 0.0635 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0893 - val_loss: 0.0642 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0856 - val_loss: 0.0649 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0811 - val_loss: 0.0676 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0764 - val_loss: 0.0702 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0739 - val_loss: 0.0723 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0740 - val_loss: 0.0690 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0734 - val_loss: 0.0777 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0714 - val_loss: 0.0655 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0691 - val_loss: 0.0758 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0666 - val_loss: 0.0686 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0674 - val_loss: 0.0675 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0669 - val_loss: 0.0737 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0651 - val_loss: 0.0725 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0652 - val_loss: 0.0708 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0654 - val_loss: 0.0717 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0649 - val_loss: 0.0726 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0648 - val_loss: 0.0725 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0629 - val_loss: 0.0720 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0626 - val_loss: 0.0720 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0649 - val_loss: 0.0715 - lr: 4.9787e-05
Epoch 1/100

2023-11-27 18:15:31.368128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.368744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.369171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:31.422024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.422434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.422790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:31.506035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.506536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.506978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:31.566173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.566623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.567041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:31.802377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.802831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.803232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:31.874902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:31.875379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:31.875822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 26ms/step - loss: 0.1573 - val_loss: 0.1309 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1001

2023-11-27 18:15:32.492659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:32.493175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:32.493841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:32.558170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:32.558668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:32.559091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 6ms/step - loss: 0.1171 - val_loss: 0.1184 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1109 - val_loss: 0.1212 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1050 - val_loss: 0.1164 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0973 - val_loss: 0.1042 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0948 - val_loss: 0.0964 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0894 - val_loss: 0.0909 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0880 - val_loss: 0.0869 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0809 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0732 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0695 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0662 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0640 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0687 - val_loss: 0.0625 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0610 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0582 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0567 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0562 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0550 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0537 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0527 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0527 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0570 - val_loss: 0.0514 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0518 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0505 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0498 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0497 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0498 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0496 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0491 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0490 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0492 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0492 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0492 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0491 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0491 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0525 - val_loss: 0.0490 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0490 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0490 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0490 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0490 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0490 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0490 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0537 - val_loss: 0.0490 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0490 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0490 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0531 - val_loss: 0.0490 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0490 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0490 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0540 - val_loss: 0.0490 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0524 - val_loss: 0.0490 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0490 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0490 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0521 - val_loss: 0.0490 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0536 - val_loss: 0.0490 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0490 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0490 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0490 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0490 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0529 - val_loss: 0.0490 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0532 - val_loss: 0.0490 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0549 - val_loss: 0.0490 - lr: 1.3816e-12
Epoch 70/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0530 - val_loss: 0.0490 - lr: 7.5826e-13
Epoch 71/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 3.7654e-13
Epoch 72/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0490 - lr: 1.8698e-13
Epoch 73/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0490 - lr: 9.2853e-14
Epoch 74/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0490 - lr: 4.6110e-14
Epoch 1/100

2023-11-27 18:15:37.742482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:37.743148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:37.743558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:37.801108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:37.801485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:37.801838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:37.887617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:37.888122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:37.888561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:37.953111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:37.953757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:37.954244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:38.192769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:38.193220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:38.193696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:38.251704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:38.252158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:38.252568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.1278 - val_loss: 0.1019 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1272

2023-11-27 18:15:38.905506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:38.906008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:38.906418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:38.969214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:38.969670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:38.970050: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1073 - val_loss: 0.0973 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.0943 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0944 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0986 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0983 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0980 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1002 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.0976 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0955 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0791 - val_loss: 0.0852 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0933 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0877 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0829 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0677 - val_loss: 0.0819 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0648 - val_loss: 0.0841 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0796 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0764 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0731 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0739 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0693 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0690 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0584 - val_loss: 0.0676 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0669 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0663 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0653 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0651 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0568 - val_loss: 0.0646 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0647 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0645 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0642 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0638 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0639 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0639 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0639 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0640 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0640 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0640 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0640 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0640 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0639 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0639 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0639 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0639 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0639 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0639 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0639 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0548 - val_loss: 0.0639 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0639 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0639 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0639 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0639 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:15:43.635032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:43.635470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:43.635983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:43.692294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:43.692658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:43.693027: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:43.779534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:43.780080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:43.780631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:43.847347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:43.848044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:43.848523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:44.102767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:44.103259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:44.103710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:44.166479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:44.167033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:44.167452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 17ms/step - loss: 0.1335 - val_loss: 0.1046 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1343

2023-11-27 18:15:44.823660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:44.824160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:44.824830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:44.887546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:44.887982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:44.888502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1042 - val_loss: 0.0945 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0867 - val_loss: 0.0855 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0820 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0793 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0785 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0752 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0740 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0680 - val_loss: 0.0728 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0705 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0674 - val_loss: 0.0718 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0792 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0894 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0790 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0747 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0645 - val_loss: 0.0772 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0727 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0699 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0679 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0677 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0618 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0601 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0592 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0585 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0578 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0575 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0573 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0571 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0566 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0566 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0565 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0566 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0566 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0565 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0564 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0564 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0564 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0564 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0564 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0564 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0564 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0564 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0564 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0564 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0564 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0564 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0564 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0564 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0564 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0564 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0564 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0564 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0564 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0564 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0564 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0564 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0564 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0564 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0564 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0564 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0564 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0564 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0564 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0564 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0564 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0564 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0564 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0564 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0564 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0564 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0564 - lr: 9.2853e-14
Average Validation Loss: 0.06638384833931923
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:15:52.611517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:52.611991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:52.612424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:52.665183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:52.665599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:52.666107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:52.751655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:52.752075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:52.752484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:52.815889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:52.816507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:52.816992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:53.074945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:53.075838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:53.076345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:53.143341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:53.143868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:53.144483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 2s 19ms/step - loss: 0.2115 - val_loss: 0.1860 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1290

2023-11-27 18:15:54.290934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:54.291426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:54.292479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:54.352529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:54.352976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:54.353361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1678 - val_loss: 0.1806 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1575 - val_loss: 0.1704 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1527 - val_loss: 0.1629 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1447 - val_loss: 0.1596 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1404 - val_loss: 0.1564 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1319 - val_loss: 0.1518 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1291 - val_loss: 0.1498 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1233 - val_loss: 0.1470 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1191 - val_loss: 0.1409 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1086 - val_loss: 0.1381 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1001 - val_loss: 0.1398 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0985 - val_loss: 0.1287 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0939 - val_loss: 0.1268 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.1270 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0849 - val_loss: 0.1221 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0796 - val_loss: 0.1260 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.1263 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.1164 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.1296 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0743 - val_loss: 0.1166 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0733 - val_loss: 0.1227 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0716 - val_loss: 0.1229 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0725 - val_loss: 0.1190 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1229 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.1173 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.1227 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.1192 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.1180 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.1192 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1211 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.1193 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.1198 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.1186 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.1180 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.1191 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0695 - val_loss: 0.1194 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1198 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.1199 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:15:57.220035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.220463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.221093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:57.272494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.272860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.273201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:57.358404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.358935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.359410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:57.424623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.425386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.425863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:57.627699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.628404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.628813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:57.688241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:57.688731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:57.689132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1942 - val_loss: 0.1277 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1411

2023-11-27 18:15:58.209441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:58.210024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:58.210601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:15:58.273748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:15:58.274205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:15:58.274593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1751 - val_loss: 0.1219 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1613 - val_loss: 0.1141 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1549 - val_loss: 0.1045 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1495 - val_loss: 0.1042 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1428 - val_loss: 0.0957 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1386 - val_loss: 0.1052 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1339 - val_loss: 0.0879 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1305 - val_loss: 0.0951 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1274 - val_loss: 0.0859 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1213 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1177 - val_loss: 0.0907 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1150 - val_loss: 0.0862 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1103 - val_loss: 0.0821 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1059 - val_loss: 0.0817 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1003 - val_loss: 0.0813 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0983 - val_loss: 0.0774 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0930 - val_loss: 0.0744 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0934 - val_loss: 0.0717 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0705 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0699 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0823 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0827 - val_loss: 0.0697 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0794 - val_loss: 0.0710 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0789 - val_loss: 0.0705 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0787 - val_loss: 0.0706 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0779 - val_loss: 0.0716 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0703 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0713 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0761 - val_loss: 0.0718 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0727 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0738 - val_loss: 0.0726 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0754 - val_loss: 0.0728 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.0732 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0735 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0737 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0735 - val_loss: 0.0736 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0736 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0732 - val_loss: 0.0734 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0734 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0733 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0734 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:16:02.243439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.243859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.244441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:02.298020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.298480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.298863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:02.384391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.384823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.385236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:02.451231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.451983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.452468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:02.711192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.711954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.712392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:02.773311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:02.773776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:02.774218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 8ms/step - loss: 0.1853 - val_loss: 0.1696 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1316

2023-11-27 18:16:03.489329: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:03.489797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:03.490324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:03.550370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:03.550820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:03.551193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1557 - val_loss: 0.1485 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1418 - val_loss: 0.1362 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1301 - val_loss: 0.1238 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1271 - val_loss: 0.1158 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1238 - val_loss: 0.1113 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1200 - val_loss: 0.1070 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1146 - val_loss: 0.1037 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1114 - val_loss: 0.1012 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1064 - val_loss: 0.0951 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1054 - val_loss: 0.0965 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1025 - val_loss: 0.0929 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0953 - val_loss: 0.0878 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0919 - val_loss: 0.0834 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0877 - val_loss: 0.0785 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0842 - val_loss: 0.0735 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0801 - val_loss: 0.0695 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0666 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0650 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0640 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0634 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0701 - val_loss: 0.0635 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0606 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0579 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0574 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0567 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0569 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0570 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0576 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0576 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0568 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0573 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0572 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0573 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0574 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0572 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0572 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0573 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0573 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0573 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0573 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0573 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0573 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0573 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0573 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0638 - val_loss: 0.0573 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:16:11.089299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.090019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.090445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:11.144387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.144770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.145106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:11.225969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.226455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.226875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:11.287905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.288412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.288838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:11.544486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.545200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.545661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:11.611990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:11.612491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:11.612967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1689 - val_loss: 0.1612 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1505

2023-11-27 18:16:12.414988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:12.415749: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:12.416208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:12.477888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:12.478320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:12.478729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1502 - val_loss: 0.1484 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1389 - val_loss: 0.1426 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1304 - val_loss: 0.1345 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1243 - val_loss: 0.1319 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1185 - val_loss: 0.1223 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1162 - val_loss: 0.1283 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1123 - val_loss: 0.1121 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1059 - val_loss: 0.1097 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1017 - val_loss: 0.1085 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0994 - val_loss: 0.1034 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0945 - val_loss: 0.1059 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0904 - val_loss: 0.0984 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0863 - val_loss: 0.0988 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0822 - val_loss: 0.0990 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0933 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0925 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0750 - val_loss: 0.0903 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0741 - val_loss: 0.0887 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0883 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0857 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0861 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0834 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0836 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0780 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0686 - val_loss: 0.0770 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0702 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0682 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0664 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0638 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0644 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0631 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0630 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0629 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0630 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0630 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0627 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0627 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0626 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0651 - val_loss: 0.0626 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0646 - val_loss: 0.0626 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0626 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0626 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0626 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0626 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0626 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0626 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0644 - val_loss: 0.0626 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0625 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0625 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0641 - val_loss: 0.0625 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0625 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0625 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0625 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0625 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0625 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0625 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0625 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0662 - val_loss: 0.0625 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0625 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0625 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0625 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0625 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0625 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0625 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0625 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0657 - val_loss: 0.0625 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0625 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0625 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0625 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0650 - val_loss: 0.0625 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0655 - val_loss: 0.0625 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0625 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0625 - lr: 3.1068e-16
Epoch 82/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0625 - lr: 1.3960e-16
Epoch 1/100

2023-11-27 18:16:29.671889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:29.672347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:29.672915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:29.725942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:29.726414: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:29.726927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:29.808951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:29.809444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:29.809862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:29.870508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:29.870976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:29.871391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:30.116405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:30.117012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:30.117611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:30.177535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:30.178013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:30.178611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1738 - val_loss: 0.1432 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0930

2023-11-27 18:16:31.012304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:31.012904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:31.013302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:31.077662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:31.078133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:31.078532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1443 - val_loss: 0.1273 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1299 - val_loss: 0.1182 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1194 - val_loss: 0.1103 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.1055 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1073 - val_loss: 0.1017 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1041 - val_loss: 0.0971 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0919 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0894 - val_loss: 0.0894 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0856 - val_loss: 0.0843 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0831 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0793 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0790 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0764 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0756 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0751 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0667 - val_loss: 0.0731 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0708 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0704 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0648 - val_loss: 0.0705 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0668 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0652 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0663 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0657 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0680 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0544 - val_loss: 0.0687 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0691 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0676 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0680 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0656 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0646 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0639 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0632 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0627 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0629 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0624 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0626 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0625 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0624 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0624 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0624 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0624 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0624 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0624 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0624 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0624 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0512 - val_loss: 0.0624 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0624 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0624 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0624 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0624 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0624 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0624 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0624 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0624 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0624 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0624 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0624 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0624 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0624 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0624 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0624 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0514 - val_loss: 0.0624 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0624 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0624 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0517 - val_loss: 0.0624 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0515 - val_loss: 0.0624 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0624 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0624 - lr: 7.5826e-13
Average Validation Loss: 0.07326104566454887
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:16:48.636547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:48.637060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:48.637555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:48.689013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:48.689401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:48.689742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:48.769003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:48.769472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:48.769897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:48.830294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:48.830802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:48.831242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:49.069226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:49.069702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:49.070146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:49.132725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:49.133262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:49.133672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.2244 - val_loss: 0.1867 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1329

2023-11-27 18:16:49.723333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:49.723810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:49.724478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:49.785450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:49.785986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:49.786340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 5ms/step - loss: 0.1652 - val_loss: 0.1876 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1637 - val_loss: 0.1888 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1630 - val_loss: 0.1837 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1581 - val_loss: 0.1772 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1534 - val_loss: 0.1718 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1490 - val_loss: 0.1681 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1448 - val_loss: 0.1661 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1412 - val_loss: 0.1630 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1325 - val_loss: 0.1586 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1308 - val_loss: 0.1495 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1178 - val_loss: 0.1443 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1128 - val_loss: 0.1291 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0988 - val_loss: 0.1360 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.1303 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.1243 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.1297 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0908 - val_loss: 0.1245 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0872 - val_loss: 0.1210 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0868 - val_loss: 0.1193 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.1254 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.1203 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1194 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1229 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1204 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1177 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.1182 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1173 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.1174 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1173 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.1173 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1173 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.1171 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1173 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1174 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1173 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1173 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.1174 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.1174 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.1174 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.1174 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0816 - val_loss: 0.1174 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.1174 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1174 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0834 - val_loss: 0.1174 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1174 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.1174 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1174 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0828 - val_loss: 0.1174 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.1174 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1174 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.1174 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1174 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:16:52.309632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.310052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.310695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:52.363438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.363870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.364227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:52.445281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.445774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.446187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:52.505104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.505546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.505972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:52.686109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.686559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.687017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:52.744441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:52.744889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:52.745364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.2063 - val_loss: 0.1450 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1464

2023-11-27 18:16:53.222770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:53.223206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:53.223736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:53.283695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:53.284137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:53.284512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 3ms/step - loss: 0.1830 - val_loss: 0.1382 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1688 - val_loss: 0.1260 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1601 - val_loss: 0.1162 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1510 - val_loss: 0.1102 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1469 - val_loss: 0.1027 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1385 - val_loss: 0.1118 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1311 - val_loss: 0.0991 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1291 - val_loss: 0.1014 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1198 - val_loss: 0.0993 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1135 - val_loss: 0.0998 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1090 - val_loss: 0.0955 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1039 - val_loss: 0.0958 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1016 - val_loss: 0.0933 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0978 - val_loss: 0.0934 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0966 - val_loss: 0.0905 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0885 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0904 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0922 - val_loss: 0.0917 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0900 - val_loss: 0.0906 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.0913 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.0876 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0886 - val_loss: 0.0908 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0861 - val_loss: 0.0891 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0907 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0861 - val_loss: 0.0892 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0906 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0898 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0854 - val_loss: 0.0918 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0854 - val_loss: 0.0911 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0861 - val_loss: 0.0901 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0854 - val_loss: 0.0888 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0855 - val_loss: 0.0888 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0845 - val_loss: 0.0895 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0851 - val_loss: 0.0895 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0847 - val_loss: 0.0893 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0859 - val_loss: 0.0889 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0854 - val_loss: 0.0890 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0857 - val_loss: 0.0890 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0845 - val_loss: 0.0889 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0889 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0889 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:16:55.803439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:55.803863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:55.804305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:55.857422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:55.857882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:55.858196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:55.943145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:55.943682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:55.944094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:56.004814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:56.005330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:56.005936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:56.241882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:56.243280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:56.243822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:56.311877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:56.312430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:56.312891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1828 - val_loss: 0.1726 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1118

2023-11-27 18:16:56.944442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:56.944923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:56.945538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:16:57.006435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:16:57.006869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:16:57.007254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1595 - val_loss: 0.1599 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1472 - val_loss: 0.1457 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1392 - val_loss: 0.1338 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1331 - val_loss: 0.1268 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1293 - val_loss: 0.1228 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1240 - val_loss: 0.1176 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1205 - val_loss: 0.1132 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1150 - val_loss: 0.1102 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1136 - val_loss: 0.1056 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1097 - val_loss: 0.1034 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1078 - val_loss: 0.1022 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1036 - val_loss: 0.0982 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0995 - val_loss: 0.0943 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0982 - val_loss: 0.0904 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0954 - val_loss: 0.0881 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0929 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0915 - val_loss: 0.0861 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0880 - val_loss: 0.0824 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0859 - val_loss: 0.0802 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0837 - val_loss: 0.0792 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0831 - val_loss: 0.0800 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0829 - val_loss: 0.0786 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0803 - val_loss: 0.0793 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0772 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0792 - val_loss: 0.0777 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0766 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0755 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0764 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0776 - val_loss: 0.0758 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0761 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0758 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0782 - val_loss: 0.0757 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0755 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0760 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0758 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0755 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0754 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.0754 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0754 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.0753 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0753 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0753 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0783 - val_loss: 0.0753 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.0753 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0753 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0750 - val_loss: 0.0753 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.0753 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0754 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.0753 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0753 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0783 - val_loss: 0.0753 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0776 - val_loss: 0.0753 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0770 - val_loss: 0.0753 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0753 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.0753 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0753 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0753 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0753 - lr: 5.0435e-10
Epoch 60/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0753 - lr: 3.0590e-10
Epoch 61/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.0753 - lr: 1.6788e-10
Epoch 62/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.0753 - lr: 9.2136e-11
Epoch 1/100

2023-11-27 18:17:03.296842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.297829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.298384: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:03.353739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.354117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.354388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:03.441480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.442083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.442508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:03.508923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.509747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.510269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:03.758206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.758767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.759198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:03.816905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:03.817359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:03.817774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 2s 12ms/step - loss: 0.1790 - val_loss: 0.1588 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1267

2023-11-27 18:17:04.989588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:04.990197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:04.990617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:05.054402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:05.054878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:05.055284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1559 - val_loss: 0.1466 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1393 - val_loss: 0.1446 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1271 - val_loss: 0.1260 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1170 - val_loss: 0.1142 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1086 - val_loss: 0.1101 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1043 - val_loss: 0.1072 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1020 - val_loss: 0.0951 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0996 - val_loss: 0.1060 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0955 - val_loss: 0.0895 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0912 - val_loss: 0.0944 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0872 - val_loss: 0.0917 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0851 - val_loss: 0.0876 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0856 - val_loss: 0.0946 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0905 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.0932 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0982 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0815 - val_loss: 0.1034 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0826 - val_loss: 0.1046 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0813 - val_loss: 0.0985 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0815 - val_loss: 0.0944 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0837 - val_loss: 0.0842 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0782 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0690 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0750 - val_loss: 0.0669 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0669 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0666 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0658 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0656 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0715 - val_loss: 0.0654 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0718 - val_loss: 0.0654 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0653 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0651 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0650 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0651 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0651 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0700 - val_loss: 0.0651 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0651 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0651 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0696 - val_loss: 0.0651 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0651 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0652 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.0652 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0691 - val_loss: 0.0652 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0652 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0652 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0652 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.0652 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0652 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0652 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0700 - val_loss: 0.0652 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0652 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0698 - val_loss: 0.0652 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:17:12.142611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.143068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.143679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:12.198182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.198582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.198928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:12.279625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.280066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.280493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:12.339858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.340354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.340793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:12.585419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.585891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.586320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:12.644317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:12.644773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:12.645192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.2061 - val_loss: 0.1577 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1205

2023-11-27 18:17:13.328290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:13.328835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:13.329491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:13.390333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:13.390775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:13.391174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1617 - val_loss: 0.1461 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1463 - val_loss: 0.1377 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1339 - val_loss: 0.1314 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1227 - val_loss: 0.1280 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1132 - val_loss: 0.1245 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1068 - val_loss: 0.1206 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.1174 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0980 - val_loss: 0.1136 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0936 - val_loss: 0.1086 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0889 - val_loss: 0.1053 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0859 - val_loss: 0.1023 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.0996 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0809 - val_loss: 0.0974 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.0944 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0890 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0872 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0832 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0810 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0807 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0637 - val_loss: 0.0801 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0793 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0771 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0621 - val_loss: 0.0772 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.0758 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0749 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0723 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0717 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0713 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0713 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0712 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0711 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0712 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0711 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0711 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0712 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0712 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0712 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0712 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0712 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0712 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0712 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0712 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0712 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0712 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0712 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0712 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0712 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0712 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0712 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0712 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0712 - lr: 1.0130e-08
Average Validation Loss: 0.083241206407547
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:17:21.717513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:21.718058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:21.718405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:21.776886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:21.777319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:21.777688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:21.859507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:21.859997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:21.860422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:21.921445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:21.921954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:21.922370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:22.154583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:22.155052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:22.155492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:22.214011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:22.214469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:22.214873: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 68ms/step - loss: 0.2632 - val_loss: 0.2180 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1560

2023-11-27 18:17:22.780286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:22.780761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:22.781463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:22.843075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:22.843452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:22.843833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1909 - val_loss: 0.1897 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1687 - val_loss: 0.1917 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1664 - val_loss: 0.1961 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1706 - val_loss: 0.1983 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1735 - val_loss: 0.1971 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1696 - val_loss: 0.1936 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1654 - val_loss: 0.1890 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1600 - val_loss: 0.1844 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1578 - val_loss: 0.1802 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1559 - val_loss: 0.1770 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1522 - val_loss: 0.1742 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1503 - val_loss: 0.1722 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1489 - val_loss: 0.1705 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1495 - val_loss: 0.1683 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1439 - val_loss: 0.1660 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1444 - val_loss: 0.1640 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1387 - val_loss: 0.1626 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1366 - val_loss: 0.1617 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1365 - val_loss: 0.1609 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1347 - val_loss: 0.1602 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1324 - val_loss: 0.1598 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1353 - val_loss: 0.1595 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1314 - val_loss: 0.1593 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1330 - val_loss: 0.1588 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1307 - val_loss: 0.1584 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1285 - val_loss: 0.1582 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1295 - val_loss: 0.1579 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1289 - val_loss: 0.1577 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1312 - val_loss: 0.1575 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1281 - val_loss: 0.1574 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1290 - val_loss: 0.1573 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1335 - val_loss: 0.1572 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1293 - val_loss: 0.1571 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1290 - val_loss: 0.1571 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1291 - val_loss: 0.1570 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1287 - val_loss: 0.1570 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1293 - val_loss: 0.1570 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1313 - val_loss: 0.1570 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1289 - val_loss: 0.1570 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1287 - val_loss: 0.1570 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1300 - val_loss: 0.1570 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1283 - val_loss: 0.1570 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1329 - val_loss: 0.1570 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1284 - val_loss: 0.1570 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1272 - val_loss: 0.1570 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1278 - val_loss: 0.1570 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1244 - val_loss: 0.1570 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1284 - val_loss: 0.1570 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1290 - val_loss: 0.1570 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1292 - val_loss: 0.1570 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1293 - val_loss: 0.1570 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1306 - val_loss: 0.1570 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1281 - val_loss: 0.1570 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1303 - val_loss: 0.1570 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1294 - val_loss: 0.1570 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1291 - val_loss: 0.1570 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1320 - val_loss: 0.1570 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1269 - val_loss: 0.1570 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1297 - val_loss: 0.1570 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1285 - val_loss: 0.1570 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1327 - val_loss: 0.1570 - lr: 9.2136e-11
Epoch 1/100

2023-11-27 18:17:25.212508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.213140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.213544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:25.266848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.267199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.267542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:25.351533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.352028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.352458: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:25.413620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.414100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.414638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:25.650753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.651198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.651638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:25.712302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:25.712791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:25.713262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 35ms/step - loss: 0.2200 - val_loss: 0.1775 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1419

2023-11-27 18:17:26.310783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:26.311348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:26.311901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:26.372082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:26.372440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:26.372811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1816 - val_loss: 0.1446 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1802 - val_loss: 0.1359 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1698 - val_loss: 0.1307 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1607 - val_loss: 0.1278 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1552 - val_loss: 0.1237 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1466 - val_loss: 0.1210 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1411 - val_loss: 0.1150 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1309 - val_loss: 0.1184 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1249 - val_loss: 0.1168 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1222 - val_loss: 0.1113 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1150 - val_loss: 0.1172 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1127 - val_loss: 0.1142 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1086 - val_loss: 0.1069 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1083 - val_loss: 0.1090 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1064 - val_loss: 0.1078 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1044 - val_loss: 0.1052 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1031 - val_loss: 0.1041 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1015 - val_loss: 0.1059 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1014 - val_loss: 0.0956 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0994 - val_loss: 0.1064 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.0997 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0981 - val_loss: 0.1003 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0967 - val_loss: 0.1021 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0959 - val_loss: 0.1025 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0986 - val_loss: 0.0997 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0951 - val_loss: 0.0989 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0964 - val_loss: 0.0989 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0958 - val_loss: 0.0999 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0972 - val_loss: 0.0997 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.0997 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0954 - val_loss: 0.1001 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0965 - val_loss: 0.1002 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0956 - val_loss: 0.1000 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0949 - val_loss: 0.1000 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0965 - val_loss: 0.1003 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0933 - val_loss: 0.1003 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0958 - val_loss: 0.1003 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0938 - val_loss: 0.1002 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0947 - val_loss: 0.1002 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:17:28.534706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:28.535162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:28.535612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:28.586135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:28.586480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:28.586833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:28.668091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:28.668562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:28.668979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:28.728445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:28.728928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:28.729356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:28.963010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:28.963564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:28.964159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:29.022026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:29.022480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:29.022886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 26ms/step - loss: 0.2554 - val_loss: 0.2332 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1440

2023-11-27 18:17:29.640229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:29.640722: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:29.641423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:29.704333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:29.704777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:29.705174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 6ms/step - loss: 0.1802 - val_loss: 0.1862 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1668 - val_loss: 0.1718 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1577 - val_loss: 0.1631 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1525 - val_loss: 0.1541 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1484 - val_loss: 0.1521 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1413 - val_loss: 0.1426 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1352 - val_loss: 0.1347 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1292 - val_loss: 0.1247 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1273 - val_loss: 0.1163 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1192 - val_loss: 0.1106 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1179 - val_loss: 0.1059 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1121 - val_loss: 0.1021 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1088 - val_loss: 0.0981 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.0983 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1033 - val_loss: 0.0934 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1043 - val_loss: 0.0924 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1021 - val_loss: 0.0918 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0989 - val_loss: 0.0892 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0987 - val_loss: 0.0884 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.0886 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0958 - val_loss: 0.0885 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.0879 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.0865 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0867 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0946 - val_loss: 0.0861 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0857 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.0856 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0850 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0849 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0851 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0924 - val_loss: 0.0851 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0921 - val_loss: 0.0850 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0850 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0849 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0849 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0849 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0849 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0849 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0931 - val_loss: 0.0849 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0849 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0849 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0849 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0849 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0929 - val_loss: 0.0849 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0849 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.0849 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0917 - val_loss: 0.0849 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0849 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0935 - val_loss: 0.0849 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.0849 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.0849 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.0849 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0849 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0849 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.0849 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0926 - val_loss: 0.0849 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0849 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0926 - val_loss: 0.0849 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0849 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0909 - val_loss: 0.0849 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.0849 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0849 - lr: 5.0565e-11
Epoch 1/100

2023-11-27 18:17:34.111518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.112544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.112996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:34.174348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.174789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.175163: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:34.260959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.261457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.261892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:34.324203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.325038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.325448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:34.560393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.560848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.561326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:34.619125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:34.619620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:34.620039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 20ms/step - loss: 0.2192 - val_loss: 0.1621 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1524

2023-11-27 18:17:35.234318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:35.234808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:35.235475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:35.297094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:35.297517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:35.297899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 6ms/step - loss: 0.1648 - val_loss: 0.1428 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1485 - val_loss: 0.1479 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1397 - val_loss: 0.1370 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1317 - val_loss: 0.1282 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1236 - val_loss: 0.1236 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1201 - val_loss: 0.1245 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1166 - val_loss: 0.1245 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1140 - val_loss: 0.1162 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1094 - val_loss: 0.1096 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1050 - val_loss: 0.1034 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1016 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0998 - val_loss: 0.0937 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.0879 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0944 - val_loss: 0.0842 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0912 - val_loss: 0.0788 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.0781 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0893 - val_loss: 0.0751 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0869 - val_loss: 0.0721 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0730 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0706 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0680 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0669 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0681 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.0660 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0661 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0660 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0657 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0650 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0648 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0808 - val_loss: 0.0648 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0649 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0648 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0648 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0648 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0647 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0647 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0647 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0647 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0647 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0647 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0647 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0647 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0647 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0647 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0647 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0647 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0647 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0647 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0647 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0810 - val_loss: 0.0647 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0647 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0784 - val_loss: 0.0647 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0647 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0647 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0647 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0647 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0647 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0806 - val_loss: 0.0647 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.0647 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.0647 - lr: 9.2136e-11
Epoch 1/100

2023-11-27 18:17:40.713547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:40.714045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:40.714422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:40.768416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:40.768805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:40.769141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:40.857340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:40.858262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:40.858778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:40.927857: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:40.928503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:40.929176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:41.173997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:41.174555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:41.175002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:41.233723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:41.234186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:41.234603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 16ms/step - loss: 0.1813 - val_loss: 0.1620 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1857

2023-11-27 18:17:41.867048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:41.867517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:41.868167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:41.930225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:41.930678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:41.931053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1664 - val_loss: 0.1529 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1532 - val_loss: 0.1480 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1463 - val_loss: 0.1424 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1377 - val_loss: 0.1363 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1322 - val_loss: 0.1335 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1280 - val_loss: 0.1282 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1227 - val_loss: 0.1251 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1190 - val_loss: 0.1218 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1135 - val_loss: 0.1201 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1144 - val_loss: 0.1188 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1098 - val_loss: 0.1186 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1063 - val_loss: 0.1152 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1023 - val_loss: 0.1118 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0993 - val_loss: 0.1118 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0973 - val_loss: 0.1131 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0956 - val_loss: 0.1087 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.1067 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.1052 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.1032 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.1030 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1002 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0818 - val_loss: 0.0978 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0981 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0790 - val_loss: 0.0963 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0947 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0776 - val_loss: 0.0933 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0930 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0921 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0925 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0918 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0917 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0915 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0915 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0915 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0914 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.0915 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0915 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0914 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0914 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0914 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0914 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0914 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0914 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0914 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0914 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0914 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0914 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0914 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0914 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0914 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0914 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0914 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0914 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0914 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0914 - lr: 1.3710e-09
Average Validation Loss: 0.09871050417423248
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:17:48.016332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.016821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.017200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:48.069328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.069750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.070139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:48.151208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.151704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.152122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:48.211861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.212339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.212769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:48.446310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.446768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.447336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:48.505468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:48.505933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:48.506354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 19ms/step - loss: 0.1540 - val_loss: 0.2014 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1722

2023-11-27 18:17:49.123236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:49.123743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:49.124167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:49.184459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:49.184907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:49.185318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1721 - val_loss: 0.1714 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1600 - val_loss: 0.1595 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1450 - val_loss: 0.1613 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1404 - val_loss: 0.1566 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1349 - val_loss: 0.1513 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1231 - val_loss: 0.1554 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1234 - val_loss: 0.1489 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1170 - val_loss: 0.1379 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1045 - val_loss: 0.1318 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0964 - val_loss: 0.1282 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0975 - val_loss: 0.1272 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0922 - val_loss: 0.1500 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0951 - val_loss: 0.1420 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.1181 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0821 - val_loss: 0.1230 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.1377 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.1343 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.1156 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.1285 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.1263 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.1246 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1213 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0726 - val_loss: 0.1303 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1278 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.1244 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.1216 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.1290 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.1281 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0712 - val_loss: 0.1218 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.1219 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.1238 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.1228 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.1219 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.1210 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.1206 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1205 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.1207 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.1209 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:17:51.935260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:51.935691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:51.936287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:51.987245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:51.987633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:51.987979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:52.067582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:52.068062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:52.068478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:52.126835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:52.127286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:52.127705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:52.820932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:52.821444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:52.822126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:52.880541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:52.881023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:52.881569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 2s 10ms/step - loss: 0.1846 - val_loss: 0.1193 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1383

2023-11-27 18:17:53.371386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:53.372039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:53.372562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:53.433421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:53.433872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:53.434324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1712 - val_loss: 0.1171 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1586 - val_loss: 0.1110 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1502 - val_loss: 0.1023 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1443 - val_loss: 0.0992 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1376 - val_loss: 0.1014 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1332 - val_loss: 0.0888 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1288 - val_loss: 0.1043 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1215 - val_loss: 0.0864 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1169 - val_loss: 0.1003 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1155 - val_loss: 0.0914 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1122 - val_loss: 0.0874 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1072 - val_loss: 0.0984 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0995 - val_loss: 0.1007 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0951 - val_loss: 0.1016 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0978 - val_loss: 0.0859 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0930 - val_loss: 0.0842 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0906 - val_loss: 0.0825 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0895 - val_loss: 0.0779 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0865 - val_loss: 0.0790 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0761 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0828 - val_loss: 0.0774 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0787 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0796 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0794 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0808 - val_loss: 0.0794 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0777 - val_loss: 0.0791 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0785 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0773 - val_loss: 0.0782 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0792 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0771 - val_loss: 0.0806 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0763 - val_loss: 0.0801 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0764 - val_loss: 0.0807 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0809 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.0811 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0808 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0750 - val_loss: 0.0811 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0761 - val_loss: 0.0810 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0809 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0768 - val_loss: 0.0808 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0755 - val_loss: 0.0808 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:17:57.097333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.097733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.098296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:57.148376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.148742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.149092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:57.229120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.229590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.230006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:57.288790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.289246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.289708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:57.536322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.536886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.537298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:57.595195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:57.595639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:57.596183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 8ms/step - loss: 0.1624 - val_loss: 0.1490 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1393

2023-11-27 18:17:58.292616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:58.293036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:58.293673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:17:58.354641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:17:58.355063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:17:58.355392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1456 - val_loss: 0.1376 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1350 - val_loss: 0.1270 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1306 - val_loss: 0.1220 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1248 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1186 - val_loss: 0.1134 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.1077 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1117 - val_loss: 0.1081 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1040 - val_loss: 0.1022 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.1053 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0970 - val_loss: 0.0943 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0954 - val_loss: 0.0947 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0814 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0820 - val_loss: 0.0833 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0793 - val_loss: 0.0765 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0745 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.0712 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0714 - val_loss: 0.0710 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0686 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0707 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0697 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0702 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0676 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0659 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0633 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0667 - val_loss: 0.0623 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0661 - val_loss: 0.0614 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0635 - val_loss: 0.0610 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0607 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0607 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0604 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0604 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0603 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0602 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0602 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0602 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0601 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0601 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0601 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0601 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0601 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0600 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0634 - val_loss: 0.0600 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0627 - val_loss: 0.0600 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0600 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0600 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0600 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0600 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0600 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0600 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0600 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0610 - val_loss: 0.0600 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0600 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0600 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0600 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0600 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0600 - lr: 1.3710e-09
Epoch 58/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0600 - lr: 8.3153e-10
Epoch 59/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0600 - lr: 5.0435e-10
Epoch 60/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0618 - val_loss: 0.0600 - lr: 3.0590e-10
Epoch 61/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0600 - lr: 1.6788e-10
Epoch 62/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0600 - lr: 9.2136e-11
Epoch 63/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0600 - lr: 5.0565e-11
Epoch 64/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0600 - lr: 2.7751e-11
Epoch 65/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0600 - lr: 1.5230e-11
Epoch 66/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0600 - lr: 8.3584e-12
Epoch 67/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0600 - lr: 4.5872e-12
Epoch 68/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0611 - val_loss: 0.0600 - lr: 2.5175e-12
Epoch 69/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0600 - lr: 1.3816e-12
Epoch 70/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0600 - lr: 7.5826e-13
Epoch 71/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0600 - lr: 3.7654e-13
Epoch 72/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0625 - val_loss: 0.0600 - lr: 1.8698e-13
Epoch 73/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0600 - lr: 9.2853e-14
Epoch 74/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0600 - lr: 4.6110e-14
Epoch 75/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0619 - val_loss: 0.0600 - lr: 2.2897e-14
Epoch 1/100

2023-11-27 18:18:10.293304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.293833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.294205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:10.345139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.345487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.345838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:10.426902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.427405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.427828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:10.487393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.487845: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.488260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:10.721489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.721943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.722455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:10.780154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:10.780618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:10.781004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1603 - val_loss: 0.1613 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1612

2023-11-27 18:18:11.556321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:11.556810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:11.557374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:11.618398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:11.618791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:11.619183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1439 - val_loss: 0.1398 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1296 - val_loss: 0.1259 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1242 - val_loss: 0.1218 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1200 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1126 - val_loss: 0.1058 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1082 - val_loss: 0.1058 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1012 - val_loss: 0.0951 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0963 - val_loss: 0.0907 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0955 - val_loss: 0.0890 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0904 - val_loss: 0.0831 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0816 - val_loss: 0.0852 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0817 - val_loss: 0.0779 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0786 - val_loss: 0.0763 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0749 - val_loss: 0.0733 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0714 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0686 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0649 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0631 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0652 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0632 - val_loss: 0.0614 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0603 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0620 - val_loss: 0.0606 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0589 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0585 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0623 - val_loss: 0.0569 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0548 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0605 - val_loss: 0.0541 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0536 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0533 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0532 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0603 - val_loss: 0.0532 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0531 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0531 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0530 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0530 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0530 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0530 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0530 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0530 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0530 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0530 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0530 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0530 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0530 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0530 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0530 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0592 - val_loss: 0.0530 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0530 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0530 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0530 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0530 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0530 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0530 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0530 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0530 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0602 - val_loss: 0.0530 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0594 - val_loss: 0.0530 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0530 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0530 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0581 - val_loss: 0.0530 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0530 - lr: 7.5826e-13
Epoch 1/100

2023-11-27 18:18:25.977588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:25.978028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:25.978640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:26.031302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:26.031686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:26.032034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:26.116661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:26.117179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:26.117805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:26.188789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:26.189496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:26.189888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:26.430504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:26.430967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:26.431392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:26.489460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:26.489908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:26.490322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1655 - val_loss: 0.1418 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0863

2023-11-27 18:18:27.302209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:27.302974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:27.303452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:27.363944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:27.364368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:27.364705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1419 - val_loss: 0.1277 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1305 - val_loss: 0.1204 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1238 - val_loss: 0.1154 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1164 - val_loss: 0.1100 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1125 - val_loss: 0.1055 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1084 - val_loss: 0.1017 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.0982 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0996 - val_loss: 0.0939 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0937 - val_loss: 0.0911 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0888 - val_loss: 0.0862 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0845 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0782 - val_loss: 0.0794 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0735 - val_loss: 0.0814 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0736 - val_loss: 0.0772 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0792 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0735 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0757 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0733 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0624 - val_loss: 0.0730 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0616 - val_loss: 0.0717 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0694 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0680 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0663 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0658 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0553 - val_loss: 0.0655 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0653 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0652 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0643 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0645 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0641 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0639 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0637 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0635 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0635 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0634 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0634 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0633 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0633 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0633 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0633 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0633 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0633 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0633 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0633 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0633 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0633 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0633 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0633 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0633 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0633 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0633 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0633 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0633 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0633 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0633 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0633 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0633 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0633 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0633 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0633 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0633 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0633 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0633 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0633 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0633 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0633 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0633 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0633 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0633 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0633 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0633 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0633 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0633 - lr: 6.9144e-16
Average Validation Loss: 0.07359997406601906
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:18:47.265369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.265930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.266371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:47.319300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.319695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.320023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:47.399184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.399657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.400065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:47.460131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.460603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.461024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:47.714946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.715427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.715860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:47.775374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:47.775855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:47.776265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 35ms/step - loss: 0.1881 - val_loss: 0.1769 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1027

2023-11-27 18:18:48.353872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:48.354359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:48.355008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:48.415438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:48.415876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:48.416303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 5ms/step - loss: 0.1569 - val_loss: 0.1819 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1630 - val_loss: 0.1760 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1537 - val_loss: 0.1658 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1491 - val_loss: 0.1574 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1402 - val_loss: 0.1528 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1352 - val_loss: 0.1486 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1279 - val_loss: 0.1379 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1104 - val_loss: 0.1364 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1043 - val_loss: 0.1318 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0994 - val_loss: 0.1314 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.1312 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0936 - val_loss: 0.1381 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.1257 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.1319 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0914 - val_loss: 0.1166 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.1321 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.1219 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.1232 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.1275 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.1156 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1221 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1239 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1203 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1224 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1213 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1197 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1190 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1192 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1177 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.1169 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.1174 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.1178 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.1184 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0816 - val_loss: 0.1189 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0832 - val_loss: 0.1191 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1192 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.1192 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1193 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1193 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1194 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:18:50.408572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.409011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.409468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:50.463011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.463421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.463794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:50.545791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.546309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.546770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:50.606342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.606824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.607233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:50.793957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.794412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.794807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:50.862993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:50.863506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:50.863976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.2274 - val_loss: 0.1433 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1150

2023-11-27 18:18:51.355576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:51.356159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:51.356561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:51.416671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:51.417113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:51.417491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1701 - val_loss: 0.1256 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1657 - val_loss: 0.1252 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1596 - val_loss: 0.1179 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1490 - val_loss: 0.1054 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1413 - val_loss: 0.0982 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1351 - val_loss: 0.1011 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1304 - val_loss: 0.0863 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1186 - val_loss: 0.1077 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1211 - val_loss: 0.0811 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1118 - val_loss: 0.0919 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1070 - val_loss: 0.0833 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1040 - val_loss: 0.0836 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0986 - val_loss: 0.0807 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0936 - val_loss: 0.0830 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0850 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0770 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0825 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0873 - val_loss: 0.0801 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0792 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0794 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0813 - val_loss: 0.0795 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0815 - val_loss: 0.0775 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0800 - val_loss: 0.0800 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.0773 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0775 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0794 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0792 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0790 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.0780 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0781 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0776 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0783 - val_loss: 0.0784 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0772 - val_loss: 0.0783 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0778 - val_loss: 0.0782 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0780 - val_loss: 0.0781 - lr: 6.0967e-06
Epoch 1/100

2023-11-27 18:18:53.688051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:53.688473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:53.688978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:53.739788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:53.740161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:53.740578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:53.821736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:53.822218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:53.822655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:53.881707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:53.882219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:53.882679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:54.114400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:54.114936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:54.115432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:54.173262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:54.173719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:54.174131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1987 - val_loss: 0.1694 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1181

2023-11-27 18:18:54.831617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:54.832318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:54.832702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:54.894053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:54.894476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:54.894865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1626 - val_loss: 0.1615 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1455 - val_loss: 0.1392 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1387 - val_loss: 0.1245 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1292 - val_loss: 0.1121 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1246 - val_loss: 0.1030 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1162 - val_loss: 0.0980 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1129 - val_loss: 0.0938 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1080 - val_loss: 0.0904 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.0860 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0981 - val_loss: 0.0828 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0941 - val_loss: 0.0801 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0927 - val_loss: 0.0774 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0892 - val_loss: 0.0782 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0902 - val_loss: 0.0737 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0879 - val_loss: 0.0725 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0831 - val_loss: 0.0701 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0814 - val_loss: 0.0684 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0677 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.0678 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.0720 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0777 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0785 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0696 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0710 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0716 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0691 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0699 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0691 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0700 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0707 - val_loss: 0.0698 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0701 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0708 - val_loss: 0.0692 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0695 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0704 - val_loss: 0.0693 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0691 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0692 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0699 - val_loss: 0.0691 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0692 - val_loss: 0.0691 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:18:58.912889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:58.913310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:58.913791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:58.965783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:58.966291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:58.966647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:59.058387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:59.059080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:59.059618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:59.124500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:59.125160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:59.125615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:59.365848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:59.366303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:59.366855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:18:59.424617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:18:59.425083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:18:59.425495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1844 - val_loss: 0.1554 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1381

2023-11-27 18:19:00.115474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:00.116189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:00.116598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:00.178168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:00.178617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:00.179025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1527 - val_loss: 0.1537 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1401 - val_loss: 0.1440 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1310 - val_loss: 0.1367 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1223 - val_loss: 0.1393 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1175 - val_loss: 0.1324 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1112 - val_loss: 0.1359 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1084 - val_loss: 0.1280 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1054 - val_loss: 0.1319 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1066 - val_loss: 0.1339 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1029 - val_loss: 0.1261 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0996 - val_loss: 0.1259 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0965 - val_loss: 0.1221 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0943 - val_loss: 0.1215 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0925 - val_loss: 0.1167 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0884 - val_loss: 0.1105 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0879 - val_loss: 0.1098 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0879 - val_loss: 0.1116 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.1029 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.0987 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0842 - val_loss: 0.0943 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.0847 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0833 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0787 - val_loss: 0.0797 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0763 - val_loss: 0.0772 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0752 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.0751 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0753 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0746 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0745 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0743 - val_loss: 0.0746 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.0741 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0726 - val_loss: 0.0740 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0734 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0738 - val_loss: 0.0733 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0731 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0734 - val_loss: 0.0730 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0730 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0730 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0731 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0730 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0730 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0730 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.0731 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0731 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0719 - val_loss: 0.0731 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0731 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.0731 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0733 - val_loss: 0.0731 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0718 - val_loss: 0.0731 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.0731 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0733 - val_loss: 0.0731 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.0731 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.0731 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0732 - val_loss: 0.0731 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0731 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0735 - val_loss: 0.0731 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0741 - val_loss: 0.0731 - lr: 8.3153e-10
Epoch 1/100

2023-11-27 18:19:07.444480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:07.444852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:07.445396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:07.497659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:07.498032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:07.498306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:07.582601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:07.583350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:07.584323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:07.652799: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:07.653237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:07.654135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:08.420434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:08.420891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:08.421358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:08.479263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:08.479729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:08.480058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 2s 10ms/step - loss: 0.2038 - val_loss: 0.1552 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1277

2023-11-27 18:19:09.196455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:09.196876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:09.197384: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:09.258586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:09.259024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:09.259528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1654 - val_loss: 0.1454 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1435 - val_loss: 0.1398 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1299 - val_loss: 0.1373 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1186 - val_loss: 0.1342 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1133 - val_loss: 0.1313 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1059 - val_loss: 0.1304 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 3ms/step - loss: 0.1048 - val_loss: 0.1267 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.1231 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0965 - val_loss: 0.1200 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.1190 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0917 - val_loss: 0.1164 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0870 - val_loss: 0.1141 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0855 - val_loss: 0.1125 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.1101 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0803 - val_loss: 0.1082 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0798 - val_loss: 0.1067 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0786 - val_loss: 0.1051 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0762 - val_loss: 0.1033 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.1020 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.1005 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0746 - val_loss: 0.0998 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0743 - val_loss: 0.0989 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0991 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0755 - val_loss: 0.0979 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.0964 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0953 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0946 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0941 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0936 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0933 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0931 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0685 - val_loss: 0.0930 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0682 - val_loss: 0.0929 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0928 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0928 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0927 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0674 - val_loss: 0.0927 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0927 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0926 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0926 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0926 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0926 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0926 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0926 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0926 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0926 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0926 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0926 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0926 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0926 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0926 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0926 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0926 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0671 - val_loss: 0.0926 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0926 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0926 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0675 - val_loss: 0.0926 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0926 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0926 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0674 - val_loss: 0.0926 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0926 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0683 - val_loss: 0.0926 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0926 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0926 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0926 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0926 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0926 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0926 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0677 - val_loss: 0.0926 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0926 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0676 - val_loss: 0.0926 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0673 - val_loss: 0.0926 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0926 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0926 - lr: 2.2897e-14
Average Validation Loss: 0.08515794277191162
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:19:20.800770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:20.801690: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:20.802321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:20.864649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:20.865138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:20.865499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:20.949065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:20.949561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:20.950000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:21.011946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:21.012478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:21.012902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:21.252914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:21.253577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:21.253991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:21.311385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:21.311830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:21.312261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 65ms/step - loss: 0.1837 - val_loss: 0.1888 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1551

2023-11-27 18:19:21.856768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:21.857233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:21.857890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:21.917801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:21.918285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:21.918666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 10ms/step - loss: 0.1676 - val_loss: 0.1960 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1695 - val_loss: 0.1986 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1686 - val_loss: 0.1965 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1671 - val_loss: 0.1900 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1637 - val_loss: 0.1809 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1521 - val_loss: 0.1738 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1455 - val_loss: 0.1688 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1487 - val_loss: 0.1644 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1453 - val_loss: 0.1607 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1414 - val_loss: 0.1599 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1375 - val_loss: 0.1598 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1382 - val_loss: 0.1591 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1342 - val_loss: 0.1538 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1312 - val_loss: 0.1478 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1283 - val_loss: 0.1463 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1284 - val_loss: 0.1443 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1249 - val_loss: 0.1413 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1219 - val_loss: 0.1401 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1178 - val_loss: 0.1409 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1190 - val_loss: 0.1400 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1180 - val_loss: 0.1378 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1123 - val_loss: 0.1370 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1141 - val_loss: 0.1362 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1125 - val_loss: 0.1357 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1124 - val_loss: 0.1358 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1079 - val_loss: 0.1359 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1119 - val_loss: 0.1359 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1114 - val_loss: 0.1360 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1088 - val_loss: 0.1358 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1077 - val_loss: 0.1356 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1089 - val_loss: 0.1357 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1085 - val_loss: 0.1357 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1105 - val_loss: 0.1357 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1104 - val_loss: 0.1356 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1076 - val_loss: 0.1356 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1117 - val_loss: 0.1356 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1080 - val_loss: 0.1356 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1133 - val_loss: 0.1357 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1100 - val_loss: 0.1357 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1066 - val_loss: 0.1357 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1063 - val_loss: 0.1357 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1114 - val_loss: 0.1357 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1107 - val_loss: 0.1357 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1070 - val_loss: 0.1357 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1078 - val_loss: 0.1357 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1092 - val_loss: 0.1357 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1086 - val_loss: 0.1357 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1109 - val_loss: 0.1357 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1093 - val_loss: 0.1357 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1115 - val_loss: 0.1357 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1119 - val_loss: 0.1357 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1070 - val_loss: 0.1357 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1066 - val_loss: 0.1357 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1074 - val_loss: 0.1357 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:19:23.965792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:23.966342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:23.966729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:24.020786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:24.021182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:24.021609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:24.104103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:24.104593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:24.104999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:24.164995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:24.165476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:24.165930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:24.416201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:24.416657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:24.417130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:24.476259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:24.476715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:24.477129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1880 - val_loss: 0.1403 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1498

2023-11-27 18:19:25.073576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:25.074060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:25.074763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:25.136613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:25.137066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:25.137441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1733 - val_loss: 0.1246 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1653 - val_loss: 0.1198 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1587 - val_loss: 0.1195 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1512 - val_loss: 0.1168 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1447 - val_loss: 0.1109 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1368 - val_loss: 0.1237 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1322 - val_loss: 0.1221 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1250 - val_loss: 0.1147 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1179 - val_loss: 0.1192 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1186 - val_loss: 0.1042 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1101 - val_loss: 0.1163 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1105 - val_loss: 0.1065 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1070 - val_loss: 0.1131 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1053 - val_loss: 0.1091 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1037 - val_loss: 0.1067 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1013 - val_loss: 0.1056 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0992 - val_loss: 0.1049 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0984 - val_loss: 0.1044 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0996 - val_loss: 0.1052 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0979 - val_loss: 0.1034 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0957 - val_loss: 0.1072 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0963 - val_loss: 0.1029 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0945 - val_loss: 0.0996 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0950 - val_loss: 0.0988 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0957 - val_loss: 0.1016 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0935 - val_loss: 0.1022 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0938 - val_loss: 0.1004 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0928 - val_loss: 0.0986 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0940 - val_loss: 0.0996 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0937 - val_loss: 0.1012 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0938 - val_loss: 0.1016 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0934 - val_loss: 0.1012 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0909 - val_loss: 0.1007 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0937 - val_loss: 0.1004 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0922 - val_loss: 0.1001 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0926 - val_loss: 0.1000 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0917 - val_loss: 0.1001 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0929 - val_loss: 0.1001 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0940 - val_loss: 0.1001 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0921 - val_loss: 0.1001 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0931 - val_loss: 0.1001 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0934 - val_loss: 0.1002 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0935 - val_loss: 0.1002 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0937 - val_loss: 0.1002 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0941 - val_loss: 0.1002 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0933 - val_loss: 0.1002 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0938 - val_loss: 0.1002 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0946 - val_loss: 0.1002 - lr: 6.7729e-08
Epoch 1/100

2023-11-27 18:19:27.883121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:27.883842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:27.884280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:27.939887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:27.940310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:27.940666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:28.032354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:28.032828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:28.033253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:28.101389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:28.102167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:28.102605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:28.351222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:28.351902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:28.352579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:28.418836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:28.419321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:28.419954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 27ms/step - loss: 0.1792 - val_loss: 0.1682 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1608

2023-11-27 18:19:29.059989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:29.060776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:29.061264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:29.127686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:29.128142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:29.128587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 5ms/step - loss: 0.1577 - val_loss: 0.1602 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1482 - val_loss: 0.1481 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1360 - val_loss: 0.1310 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1312 - val_loss: 0.1173 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1247 - val_loss: 0.1097 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1184 - val_loss: 0.1006 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1165 - val_loss: 0.0991 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1078 - val_loss: 0.0915 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.0833 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.0800 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0774 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0940 - val_loss: 0.0738 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0810 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0907 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0799 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0740 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0747 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.0763 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.0730 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0727 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0734 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0730 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0739 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0731 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0728 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.0726 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0718 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0769 - val_loss: 0.0719 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0776 - val_loss: 0.0725 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0721 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0719 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0720 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0717 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0716 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0719 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0720 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0720 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0765 - val_loss: 0.0720 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0720 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0720 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0720 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0720 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0720 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0763 - val_loss: 0.0720 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0720 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0720 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0720 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0720 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0720 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0720 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0720 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0770 - val_loss: 0.0720 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0720 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0720 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:19:32.937973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:32.938578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:32.938928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:32.992142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:32.992547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:32.992893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:33.075893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:33.076348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:33.076682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:33.136544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:33.137003: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:33.137416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:33.394720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:33.395174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:33.396598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:33.465533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:33.465983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:33.466399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.2126 - val_loss: 0.1550 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1565

2023-11-27 18:19:34.132844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:34.133423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:34.134084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:34.198860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:34.199319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:34.199701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1676 - val_loss: 0.1503 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1583 - val_loss: 0.1419 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1440 - val_loss: 0.1366 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1349 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1336 - val_loss: 0.1330 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1274 - val_loss: 0.1279 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1235 - val_loss: 0.1307 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1212 - val_loss: 0.1220 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1167 - val_loss: 0.1266 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1166 - val_loss: 0.1079 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1079 - val_loss: 0.1121 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1069 - val_loss: 0.1081 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1050 - val_loss: 0.1006 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1018 - val_loss: 0.1022 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1022 - val_loss: 0.0970 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0979 - val_loss: 0.0925 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.0916 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0951 - val_loss: 0.0895 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0931 - val_loss: 0.0886 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0859 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0847 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0917 - val_loss: 0.0849 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0842 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0841 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0894 - val_loss: 0.0823 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.0819 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0815 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0813 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0817 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0816 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0814 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0814 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.0814 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0890 - val_loss: 0.0813 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0813 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0880 - val_loss: 0.0813 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.0813 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.0813 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0813 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0813 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.0813 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0813 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0813 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0813 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.0813 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0891 - val_loss: 0.0813 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0889 - val_loss: 0.0813 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0813 - lr: 6.7729e-08
Epoch 1/100

2023-11-27 18:19:38.530057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:38.530790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:38.531197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:38.585648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:38.586055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:38.586415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:38.669197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:38.669768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:38.670254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:38.733469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:38.734000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:38.734421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:38.972326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:38.972868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:38.973312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:39.031565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:39.032026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:39.032448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 17ms/step - loss: 0.2140 - val_loss: 0.1566 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1695

2023-11-27 18:19:39.676790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:39.677267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:39.677945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:39.740403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:39.740893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:39.741339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1668 - val_loss: 0.1501 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1539 - val_loss: 0.1443 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1425 - val_loss: 0.1390 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1344 - val_loss: 0.1353 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1297 - val_loss: 0.1340 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1269 - val_loss: 0.1321 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1181 - val_loss: 0.1264 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1163 - val_loss: 0.1247 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1105 - val_loss: 0.1207 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1091 - val_loss: 0.1217 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1066 - val_loss: 0.1228 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1053 - val_loss: 0.1164 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.1141 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1007 - val_loss: 0.1159 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0972 - val_loss: 0.1130 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.1084 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0901 - val_loss: 0.1107 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.1077 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.1054 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.1035 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0833 - val_loss: 0.1008 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.0982 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0976 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.0953 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0954 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0927 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0927 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0916 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0913 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0910 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0907 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0904 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0901 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0899 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0898 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0898 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0897 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0896 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0896 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0896 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0896 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0896 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0896 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0896 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0896 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0896 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0896 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.0896 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0896 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0896 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0896 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0896 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0896 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0896 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0896 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0896 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0896 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0896 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0896 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0896 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0896 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0896 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0896 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0896 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.0896 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0896 - lr: 5.6464e-15
Epoch 78/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0896 - lr: 2.8039e-15
Epoch 79/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0896 - lr: 1.3924e-15
Epoch 80/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0896 - lr: 6.9144e-16
Epoch 81/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 3.1068e-16
Epoch 82/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0896 - lr: 1.3960e-16
Epoch 83/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0896 - lr: 6.2726e-17
Epoch 84/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0896 - lr: 2.8185e-17
Average Validation Loss: 0.0953439086675644
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:19:48.617745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:48.618186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:48.618783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:48.674247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:48.674654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:48.675085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:48.766386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:48.767049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:48.767494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:48.831133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:48.831707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:48.832139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:49.069363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:49.069969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:49.070420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:49.129163: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:49.129645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:49.130060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.1149 - val_loss: 0.1250 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0915

2023-11-27 18:19:49.743805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:49.744278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:49.744941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:49.811053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:49.811592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:49.812036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1139 - val_loss: 0.1139 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1058 - val_loss: 0.1137 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1001 - val_loss: 0.1122 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0897 - val_loss: 0.1187 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0922 - val_loss: 0.1054 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0749 - val_loss: 0.1281 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1316 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0776 - val_loss: 0.1135 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.1221 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.1119 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.1060 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.1131 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.1099 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.1120 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.1099 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0942 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.1049 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0984 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0497 - val_loss: 0.1131 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0990 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.1051 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.1042 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.1032 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.1028 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.1032 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.1052 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.1022 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.1047 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.1042 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.1044 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.1031 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.1027 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0466 - val_loss: 0.1017 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.1012 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.1015 - lr: 6.0967e-06
Epoch 1/100

2023-11-27 18:19:52.460375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.460758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.461193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:52.513286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.513692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.514035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:52.593358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.593838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.594265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:52.652479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.652930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.653347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:52.831298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.831773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.832262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:52.888966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:52.889420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:52.889827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1368 - val_loss: 0.0740 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1098

2023-11-27 18:19:53.385475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:53.386001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:53.386654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:53.450481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:53.450933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:53.451352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1230 - val_loss: 0.0790 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1202 - val_loss: 0.0793 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1185 - val_loss: 0.0740 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1155 - val_loss: 0.0785 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1133 - val_loss: 0.0676 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1114 - val_loss: 0.0843 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1058 - val_loss: 0.0633 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1046 - val_loss: 0.0912 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0654 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.0707 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0889 - val_loss: 0.0785 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0877 - val_loss: 0.0652 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0754 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0714 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0644 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0720 - val_loss: 0.0637 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0669 - val_loss: 0.0647 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0617 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0633 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0610 - val_loss: 0.0618 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0593 - val_loss: 0.0625 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0647 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0642 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0649 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0666 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0659 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0648 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0656 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0668 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0662 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0657 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0659 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0664 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0665 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0666 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0520 - val_loss: 0.0667 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:19:57.013581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:57.013960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:57.014320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:57.065711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:57.066117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:57.066469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:57.772989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:57.774074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:57.774639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:57.844017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:57.844921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:57.845715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:58.095554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:58.096230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:58.096645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:58.159449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:58.159891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:58.160321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 2s 8ms/step - loss: 0.1152 - val_loss: 0.1114 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0883

2023-11-27 18:19:58.873838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:58.874260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:58.874698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:19:58.934519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:19:58.934940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:19:58.935409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1078 - val_loss: 0.1000 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1051 - val_loss: 0.0937 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0997 - val_loss: 0.0877 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0967 - val_loss: 0.0867 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0923 - val_loss: 0.0822 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0901 - val_loss: 0.0763 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0777 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0849 - val_loss: 0.0788 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0612 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0706 - val_loss: 0.0664 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0698 - val_loss: 0.0549 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0528 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0559 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0586 - val_loss: 0.0508 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0574 - val_loss: 0.0560 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0502 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0542 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0520 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0555 - val_loss: 0.0503 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0504 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0491 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0474 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0560 - val_loss: 0.0459 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0468 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0466 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0465 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0463 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0468 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0467 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0468 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0475 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0474 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0476 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0476 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0476 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0477 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0476 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0475 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0475 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0475 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0475 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:20:06.095068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.095653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.096005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:06.150897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.151294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.151633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:06.237149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.237581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.238014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:06.297929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.298448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.298875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:06.537489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.538299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.538988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:06.602941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:06.603453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:06.603888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1204 - val_loss: 0.1119 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1145

2023-11-27 18:20:07.389577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:07.390179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:07.390862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:07.454348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:07.454784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:07.455173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1102 - val_loss: 0.1075 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1056 - val_loss: 0.1045 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1007 - val_loss: 0.1054 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.0982 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0885 - val_loss: 0.1005 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0899 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0799 - val_loss: 0.1009 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0766 - val_loss: 0.0945 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.1032 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0727 - val_loss: 0.0872 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0707 - val_loss: 0.0840 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0793 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0676 - val_loss: 0.0792 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0659 - val_loss: 0.0764 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0758 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0757 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0755 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0763 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0775 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0571 - val_loss: 0.0786 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0832 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0772 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0734 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0692 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0674 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0567 - val_loss: 0.0661 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0638 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0632 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0626 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0624 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0622 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0619 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0617 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0616 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0614 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0614 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0614 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0613 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0613 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0613 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0613 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0613 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0613 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0613 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0613 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0613 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0613 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0613 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0613 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0613 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0530 - val_loss: 0.0613 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0613 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0613 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0613 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0613 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0613 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0613 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0613 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0613 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0613 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0613 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0613 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0613 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0613 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0528 - val_loss: 0.0613 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0613 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0613 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0613 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0613 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0613 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0532 - val_loss: 0.0613 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0613 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0529 - val_loss: 0.0613 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0536 - val_loss: 0.0613 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0613 - lr: 5.6464e-15
Epoch 1/100

2023-11-27 18:20:23.563616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:23.564134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:23.564750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:23.620161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:23.620589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:23.620941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:23.706195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:23.706613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:23.707029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:23.767219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:23.767812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:23.768239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:24.002440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:24.002911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:24.003619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:24.064195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:24.064641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:24.065069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1230 - val_loss: 0.1009 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0697

2023-11-27 18:20:24.890152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:24.890676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:24.891229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:24.955699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:24.956161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:24.956559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1112 - val_loss: 0.0933 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1026 - val_loss: 0.0907 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.0887 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.0857 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0894 - val_loss: 0.0848 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0891 - val_loss: 0.0833 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0837 - val_loss: 0.0831 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0787 - val_loss: 0.0805 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0767 - val_loss: 0.0770 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0780 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0668 - val_loss: 0.0737 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0735 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0629 - val_loss: 0.0661 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0647 - val_loss: 0.0672 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0676 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0654 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0644 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0683 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0641 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0527 - val_loss: 0.0622 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0595 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0573 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0543 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0536 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0467 - val_loss: 0.0530 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0516 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0509 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0506 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0445 - val_loss: 0.0505 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0504 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0504 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0504 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0504 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0504 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0505 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0504 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0505 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0504 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0504 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0504 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0505 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0505 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0505 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0505 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0437 - val_loss: 0.0505 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0505 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0505 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0505 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0505 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0505 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0505 - lr: 6.1442e-09
Average Validation Loss: 0.0626798465847969
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:20:38.689445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:38.690360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:38.691038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:38.754081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:38.754499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:38.754852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:38.840519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:38.841095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:38.841552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:38.910786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:38.911396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:38.911802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:39.166911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:39.167713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:39.168217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:39.234126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:39.234664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:39.235535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 42ms/step - loss: 0.1221 - val_loss: 0.1236 - lr: 0.0010
Epoch 2/100

2023-11-27 18:20:39.881177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:39.882684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:39.883442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:39.955893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:39.956774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:39.957422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1066 - val_loss: 0.1259 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1059 - val_loss: 0.1251 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1020 - val_loss: 0.1192 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1030 - val_loss: 0.1136 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0942 - val_loss: 0.1099 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0875 - val_loss: 0.1105 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0840 - val_loss: 0.1054 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.1044 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.1025 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0647 - val_loss: 0.0968 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.1059 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.1050 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.1002 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0994 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.1066 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0976 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.1046 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0964 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.1020 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0954 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0971 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0500 - val_loss: 0.0975 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0523 - val_loss: 0.0949 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0961 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0982 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0978 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0975 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0983 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0982 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0978 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0970 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0966 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0966 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0476 - val_loss: 0.0965 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0965 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0963 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0960 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0960 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0960 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0960 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0961 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0961 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0961 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:20:42.182596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.183147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.183481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:42.237193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.237604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.237949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:42.322893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.323676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.324429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:42.392251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.392931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.393484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:42.579833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.580317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.580756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:42.640143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:42.640598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:42.641132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1746 - val_loss: 0.1001 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0672

2023-11-27 18:20:43.122600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:43.123055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:43.123466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:43.186075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:43.186513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:43.186989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 3ms/step - loss: 0.1279 - val_loss: 0.0829 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1182 - val_loss: 0.0844 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1137 - val_loss: 0.0758 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1078 - val_loss: 0.0755 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1050 - val_loss: 0.0694 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0997 - val_loss: 0.0751 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0982 - val_loss: 0.0718 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0703 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0901 - val_loss: 0.0776 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0842 - val_loss: 0.0771 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0777 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0808 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0773 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0717 - val_loss: 0.0793 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0770 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0693 - val_loss: 0.0762 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0677 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0713 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0640 - val_loss: 0.0771 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0621 - val_loss: 0.0754 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0654 - val_loss: 0.0789 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0653 - val_loss: 0.0761 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0768 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0637 - val_loss: 0.0749 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0643 - val_loss: 0.0777 - lr: 1.1080e-04
Epoch 1/100

2023-11-27 18:20:44.808581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:44.809060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:44.809608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:44.868500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:44.868980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:44.869339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:44.954477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:44.954899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:44.955380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:45.023566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:45.024427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:45.025151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:45.284085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:45.284938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:45.285309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:45.346899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:45.347397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:45.347742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1269 - val_loss: 0.1167 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0766

2023-11-27 18:20:46.005097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:46.005729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:46.006143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:46.068208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:46.068617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:46.069008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1098 - val_loss: 0.1118 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.1015 - val_loss: 0.0974 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0965 - val_loss: 0.0885 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0948 - val_loss: 0.0860 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0914 - val_loss: 0.0828 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0892 - val_loss: 0.0777 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0874 - val_loss: 0.0755 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.0724 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0842 - val_loss: 0.0696 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0791 - val_loss: 0.0665 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0748 - val_loss: 0.0634 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0610 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0601 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0578 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0568 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0553 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0556 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0553 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0539 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0537 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0556 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0602 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0573 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0559 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0557 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0558 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0542 - val_loss: 0.0562 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0562 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0557 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0565 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0568 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0563 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0561 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0559 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0559 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0560 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0559 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0559 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0529 - val_loss: 0.0559 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:20:50.268048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.268584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.269098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:50.324062: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.324471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.324816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:50.409915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.410426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.410862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:50.472461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.473146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.473530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:50.710349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.710886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.711316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:50.770103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:50.770555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:50.770888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1411 - val_loss: 0.1128 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0825

2023-11-27 18:20:51.445103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:51.445570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:51.446079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:20:51.511391: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:20:51.511848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:20:51.512239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1167 - val_loss: 0.1024 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1000 - val_loss: 0.1046 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0961 - val_loss: 0.1061 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.1019 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.0958 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0850 - val_loss: 0.0935 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.0956 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0788 - val_loss: 0.0880 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0766 - val_loss: 0.0904 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0754 - val_loss: 0.0937 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.1065 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0799 - val_loss: 0.1046 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.0942 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0781 - val_loss: 0.0919 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0758 - val_loss: 0.0897 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0728 - val_loss: 0.0874 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0725 - val_loss: 0.0847 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0703 - val_loss: 0.0849 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0763 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0752 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0752 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.0732 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0735 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0723 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0716 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0715 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0712 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0711 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0711 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0708 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0707 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0707 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0707 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0707 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0706 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0614 - val_loss: 0.0706 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0706 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0706 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0706 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0705 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0621 - val_loss: 0.0705 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0705 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0705 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0705 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0705 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0705 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0705 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0705 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0705 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0705 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0705 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0705 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0705 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0705 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0705 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0705 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0705 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0705 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0705 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0705 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0705 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0705 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0705 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0705 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0705 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0705 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0705 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0705 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0606 - val_loss: 0.0705 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0705 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0705 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0705 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0705 - lr: 2.2897e-14
Epoch 1/100

2023-11-27 18:21:01.029171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.029965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.030440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:01.089190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.089611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.089961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:01.173202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.173681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.174115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:01.235875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.236631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.237093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:01.478218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.478668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.479288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:01.537193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:01.537663: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:01.538077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

40/43 [==========================>...] - ETA: 0s - loss: 0.1260

2023-11-27 18:21:02.252805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:02.253398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:02.253797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 2s 22ms/step - loss: 0.1243 - val_loss: 0.1081 - lr: 0.0010
Epoch 2/100
16/43 [==========>...................] - ETA: 0s - loss: 0.1167

2023-11-27 18:21:02.805331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:02.805800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:02.806351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.1087 - val_loss: 0.1050 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.1036 - val_loss: 0.1045 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0946 - val_loss: 0.1016 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0899 - val_loss: 0.0989 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0969 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0784 - val_loss: 0.0920 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0750 - val_loss: 0.0910 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0723 - val_loss: 0.0838 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0688 - val_loss: 0.0821 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0825 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0847 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.0758 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0781 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0750 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0727 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0713 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0702 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0694 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0688 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0679 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0676 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0671 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0669 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0670 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0505 - val_loss: 0.0668 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0655 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0649 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0642 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0640 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0637 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0636 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0634 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0634 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0634 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0633 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0480 - val_loss: 0.0633 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0633 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0633 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0633 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0633 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0633 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0633 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0633 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0633 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0633 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0633 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0633 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0633 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0633 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0633 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0633 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0633 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0633 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0633 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0633 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0633 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0633 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0633 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0633 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0633 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0633 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0633 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0633 - lr: 1.1370e-14
Average Validation Loss: 0.07035916745662689
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:21:14.733185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:14.733691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:14.734072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:14.791144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:14.791545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:14.791864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:14.878132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:14.878640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:14.879287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:14.949363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:14.950009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:14.950506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:15.196982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:15.197760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:15.198147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:15.257662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:15.258272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:15.258731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 65ms/step - loss: 0.2052 - val_loss: 0.1642 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1006

2023-11-27 18:21:15.815708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:15.816194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:15.816820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:15.877978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:15.878397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:15.878778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1336 - val_loss: 0.1319 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1120 - val_loss: 0.1372 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1111 - val_loss: 0.1445 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1171 - val_loss: 0.1479 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1125 - val_loss: 0.1458 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1149 - val_loss: 0.1407 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1126 - val_loss: 0.1340 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1091 - val_loss: 0.1286 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1021 - val_loss: 0.1267 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0998 - val_loss: 0.1285 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0935 - val_loss: 0.1302 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0925 - val_loss: 0.1292 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0902 - val_loss: 0.1271 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.1251 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0774 - val_loss: 0.1268 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0789 - val_loss: 0.1276 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.1274 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0770 - val_loss: 0.1285 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0752 - val_loss: 0.1259 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0726 - val_loss: 0.1234 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0741 - val_loss: 0.1228 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0734 - val_loss: 0.1253 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0733 - val_loss: 0.1262 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0711 - val_loss: 0.1267 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0724 - val_loss: 0.1271 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0743 - val_loss: 0.1264 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0739 - val_loss: 0.1257 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0726 - val_loss: 0.1258 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0698 - val_loss: 0.1260 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0729 - val_loss: 0.1258 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0691 - val_loss: 0.1255 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0743 - val_loss: 0.1257 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.1258 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0714 - val_loss: 0.1260 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0729 - val_loss: 0.1260 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0706 - val_loss: 0.1261 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0695 - val_loss: 0.1261 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0711 - val_loss: 0.1261 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0699 - val_loss: 0.1261 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.1262 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.1262 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:21:17.528137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:17.528596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:17.529081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:17.581266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:17.581646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:17.581995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:17.661427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:17.661908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:17.662332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:17.721530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:17.721997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:17.722422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:17.954497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:17.954957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:17.955496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:18.012170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:18.012697: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:18.013133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1845 - val_loss: 0.1479 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0939

2023-11-27 18:21:18.616057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:18.616527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:18.617190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:18.677931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:18.678378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:18.678773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.1387 - val_loss: 0.1045 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1294 - val_loss: 0.0908 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1231 - val_loss: 0.0854 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1168 - val_loss: 0.0824 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1126 - val_loss: 0.0792 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1048 - val_loss: 0.0747 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0994 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.0706 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.0714 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0887 - val_loss: 0.0701 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0733 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0691 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0790 - val_loss: 0.0710 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0763 - val_loss: 0.0673 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0767 - val_loss: 0.0696 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0732 - val_loss: 0.0694 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0727 - val_loss: 0.0717 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0739 - val_loss: 0.0656 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0706 - val_loss: 0.0684 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0732 - val_loss: 0.0667 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0716 - val_loss: 0.0701 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0704 - val_loss: 0.0643 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0699 - val_loss: 0.0669 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0696 - val_loss: 0.0700 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0700 - val_loss: 0.0663 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0695 - val_loss: 0.0648 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0677 - val_loss: 0.0670 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0683 - val_loss: 0.0691 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0680 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0673 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0681 - val_loss: 0.0668 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0689 - val_loss: 0.0671 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0673 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0690 - val_loss: 0.0674 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0687 - val_loss: 0.0674 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0696 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0676 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0689 - val_loss: 0.0675 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0689 - val_loss: 0.0675 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0667 - val_loss: 0.0675 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0705 - val_loss: 0.0675 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0695 - val_loss: 0.0676 - lr: 7.4659e-07
Epoch 1/100

2023-11-27 18:21:20.976553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:20.977829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:20.978382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:21.037147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:21.037632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:21.038092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:21.124926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:21.125523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:21.126004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:21.190017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:21.190530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:21.191173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:21.423991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:21.424600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:21.425064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:21.483743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:21.484207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:21.484636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 25ms/step - loss: 0.1417 - val_loss: 0.1273 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1004

2023-11-27 18:21:22.088216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:22.088802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:22.089215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:22.148854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:22.149281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:22.149656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 5ms/step - loss: 0.1190 - val_loss: 0.1213 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1121 - val_loss: 0.1238 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 5ms/step - loss: 0.1037 - val_loss: 0.1172 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0978 - val_loss: 0.1073 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0970 - val_loss: 0.1016 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0920 - val_loss: 0.0955 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0879 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0816 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0798 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0772 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0721 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0722 - val_loss: 0.0675 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0657 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0670 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0680 - val_loss: 0.0627 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0604 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0620 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0582 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0572 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0567 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0562 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0564 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0562 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0562 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0600 - val_loss: 0.0564 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0616 - val_loss: 0.0557 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0560 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0563 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0562 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0561 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0560 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0560 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0559 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0559 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0559 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0560 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0560 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0605 - val_loss: 0.0560 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0590 - val_loss: 0.0560 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0608 - val_loss: 0.0560 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0602 - val_loss: 0.0560 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0608 - val_loss: 0.0560 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0560 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0560 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0560 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0560 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:21:25.618368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:25.619015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:25.619385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:25.670627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:25.671001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:25.671381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:25.752992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:25.753475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:25.753893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:25.813479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:25.813961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:25.814408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:26.047061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:26.047546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:26.047990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:26.106291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:26.106756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:26.107171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 21ms/step - loss: 0.1378 - val_loss: 0.1094 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1289

2023-11-27 18:21:26.736184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:26.736826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:26.737338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:26.800335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:26.800987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:26.801520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1158 - val_loss: 0.1012 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.0962 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.0894 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0893 - val_loss: 0.1028 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.0988 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.0948 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0820 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0676 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0600 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0712 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0669 - val_loss: 0.0777 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0839 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0723 - val_loss: 0.0701 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0493 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0646 - val_loss: 0.0458 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0442 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0435 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0436 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0440 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0445 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0446 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0440 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0433 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0436 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0435 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0559 - val_loss: 0.0436 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0439 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0432 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0430 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0430 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0433 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0434 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0434 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0433 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0434 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0434 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0564 - val_loss: 0.0434 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0433 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0433 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0433 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0433 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0433 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0433 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0433 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0433 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0433 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0433 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0558 - val_loss: 0.0433 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0557 - val_loss: 0.0433 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:21:31.193959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.194605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.195004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:31.254317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.254745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.255135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:31.344450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.345342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.346102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:31.411243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.411750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.412402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:31.659687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.660188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.660668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:31.720978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:31.721453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:31.721884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 16ms/step - loss: 0.1283 - val_loss: 0.1115 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1357

2023-11-27 18:21:32.376928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:32.377426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:32.377981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:32.439127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:32.439571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:32.439955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1119 - val_loss: 0.1042 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1046 - val_loss: 0.1047 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.1040 - val_loss: 0.1052 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0988 - val_loss: 0.1005 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.1006 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0950 - val_loss: 0.0983 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0908 - val_loss: 0.0958 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0965 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0970 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.0912 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0897 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.0903 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0888 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0856 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0840 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0812 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0782 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0773 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.0738 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0719 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0708 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0682 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0663 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0655 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0648 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0638 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0632 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0629 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0625 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0621 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0619 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0618 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0617 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0617 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0616 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0616 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0616 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0616 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0615 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0615 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0615 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0615 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0615 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0615 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0615 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0615 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0615 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0615 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0615 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0615 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0615 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0615 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0615 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0615 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0615 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0615 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0615 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0615 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0615 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0615 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0615 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0615 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0615 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0615 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0615 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0615 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0615 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0615 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0615 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0615 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.0615 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0615 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0615 - lr: 2.2897e-14
Average Validation Loss: 0.06946479007601739
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:21:40.227463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.227979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.228348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:40.283153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.283544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.283895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:40.363463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.363953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.364429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:40.423998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.424442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.424961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:40.671359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.671890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.672518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:40.732094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:40.732599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:40.733019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 19ms/step - loss: 0.1227 - val_loss: 0.1311 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.0816

2023-11-27 18:21:41.351575: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:41.352067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:41.352739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:41.413068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:41.413478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:41.413870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 4ms/step - loss: 0.1187 - val_loss: 0.1259 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1035 - val_loss: 0.1155 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1028 - val_loss: 0.1114 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1033 - val_loss: 0.1121 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0937 - val_loss: 0.1143 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1000 - val_loss: 0.1095 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.1116 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0882 - val_loss: 0.1073 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0780 - val_loss: 0.1132 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.1054 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.1025 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.1025 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.1061 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0944 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0909 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.1000 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0881 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0948 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0888 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0966 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0973 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0901 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0961 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0425 - val_loss: 0.0946 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0934 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0923 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0965 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0967 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0953 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0949 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0943 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0419 - val_loss: 0.0937 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0939 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0419 - val_loss: 0.0941 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0421 - val_loss: 0.0932 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0421 - val_loss: 0.0935 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0939 - lr: 4.5166e-06
Epoch 1/100

2023-11-27 18:21:44.093605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.094571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.095179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:44.152332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.152748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.153103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:44.233446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.233904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.234320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:44.293211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.293667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.294100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:44.472834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.473293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.473736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:44.530892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:44.531344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:44.531763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.1579 - val_loss: 0.0875 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0715

2023-11-27 18:21:45.016909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:45.017402: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:45.018060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:45.078363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:45.078780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:45.079161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1191 - val_loss: 0.0766 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1153 - val_loss: 0.0620 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.0708 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1088 - val_loss: 0.0595 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1069 - val_loss: 0.0622 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 2ms/step - loss: 0.1037 - val_loss: 0.0595 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1011 - val_loss: 0.0568 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0820 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0923 - val_loss: 0.0607 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0920 - val_loss: 0.0573 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0896 - val_loss: 0.0681 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0820 - val_loss: 0.0632 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0591 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0617 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0743 - val_loss: 0.0614 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0593 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0544 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0637 - val_loss: 0.0504 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0584 - val_loss: 0.0512 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0587 - val_loss: 0.0532 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0517 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0541 - val_loss: 0.0547 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 2ms/step - loss: 0.0504 - val_loss: 0.0555 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0513 - val_loss: 0.0594 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0584 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0506 - val_loss: 0.0577 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0509 - val_loss: 0.0596 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0508 - val_loss: 0.0606 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0607 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0602 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0602 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0601 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0604 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0603 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:21:48.583635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:48.584108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:48.584614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:48.635993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:48.636385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:48.636725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:48.719732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:48.720216: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:48.720633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:48.781307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:48.781776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:48.782197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:49.015489: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:49.016047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:49.016598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:49.074425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:49.074877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:49.075300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 2s 8ms/step - loss: 0.1169 - val_loss: 0.1119 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0734

2023-11-27 18:21:50.277396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:50.278182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:50.278592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:50.339534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:50.339969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:50.340353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 3ms/step - loss: 0.1034 - val_loss: 0.1025 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1030 - val_loss: 0.0988 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 3ms/step - loss: 0.1005 - val_loss: 0.0956 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0982 - val_loss: 0.0926 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0964 - val_loss: 0.0928 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0944 - val_loss: 0.0868 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0928 - val_loss: 0.0849 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0912 - val_loss: 0.0835 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0922 - val_loss: 0.0809 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0854 - val_loss: 0.0782 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0735 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0769 - val_loss: 0.0696 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0729 - val_loss: 0.0660 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0607 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0575 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0652 - val_loss: 0.0555 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0617 - val_loss: 0.0530 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0599 - val_loss: 0.0529 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0590 - val_loss: 0.0500 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0591 - val_loss: 0.0496 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0490 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0497 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0588 - val_loss: 0.0519 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0589 - val_loss: 0.0555 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0576 - val_loss: 0.0564 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0559 - val_loss: 0.0569 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0586 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0591 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0580 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0585 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0579 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0587 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0534 - val_loss: 0.0580 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0581 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0584 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0583 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0584 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0533 - val_loss: 0.0584 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0584 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0584 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0584 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:21:57.078202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.078625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.079184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:57.130661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.131008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.131425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:57.213492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.213979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.214565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:57.274946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.275388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.275800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:57.507427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.507957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.508370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:57.565726: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:57.566171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:57.566573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.1133 - val_loss: 0.1055 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1186

2023-11-27 18:21:58.326727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:58.327363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:58.327893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:21:58.388403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:21:58.388830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:21:58.389212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 3ms/step - loss: 0.1047 - val_loss: 0.1056 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0980 - val_loss: 0.0977 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0963 - val_loss: 0.1026 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0933 - val_loss: 0.0970 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0875 - val_loss: 0.0974 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0917 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0834 - val_loss: 0.0906 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0826 - val_loss: 0.0931 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0784 - val_loss: 0.0863 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0738 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0878 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0681 - val_loss: 0.0839 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0790 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0607 - val_loss: 0.0751 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0753 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0580 - val_loss: 0.0728 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0556 - val_loss: 0.0710 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0524 - val_loss: 0.0617 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0545 - val_loss: 0.0601 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0521 - val_loss: 0.0578 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0578 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0517 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0496 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0466 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0454 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0450 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0450 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0518 - val_loss: 0.0446 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0444 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0443 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0443 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0444 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0443 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0443 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0443 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0443 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0443 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0443 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0443 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0443 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0443 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0443 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0443 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0443 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0443 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0443 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0443 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0443 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0443 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0443 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:22:09.817906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:09.818651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:09.819360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:09.873169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:09.873574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:09.873925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:09.964526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:09.965405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:09.966093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:10.030894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:10.031572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:10.031948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:10.263679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:10.264341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:10.264773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:10.322789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:10.323183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:10.323615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 6ms/step - loss: 0.1199 - val_loss: 0.0991 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0481

2023-11-27 18:22:11.125399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:11.125872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:11.126539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:11.187890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:11.188358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:11.188764: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1023 - val_loss: 0.0951 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0912 - val_loss: 0.0936 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0911 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0842 - val_loss: 0.0905 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0809 - val_loss: 0.0880 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0745 - val_loss: 0.0828 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0772 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0749 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0658 - val_loss: 0.0776 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0779 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0636 - val_loss: 0.0830 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0615 - val_loss: 0.0806 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0583 - val_loss: 0.0821 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0796 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0840 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0798 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0841 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0740 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0523 - val_loss: 0.0718 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0685 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0670 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0653 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0651 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0438 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0641 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0639 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0638 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0636 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0631 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0430 - val_loss: 0.0628 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0627 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0417 - val_loss: 0.0623 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0622 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0410 - val_loss: 0.0621 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0620 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0621 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0420 - val_loss: 0.0620 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0621 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0621 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0421 - val_loss: 0.0621 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0417 - val_loss: 0.0621 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0621 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0620 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0413 - val_loss: 0.0620 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0620 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0620 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0414 - val_loss: 0.0620 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0620 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0620 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0620 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0620 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0415 - val_loss: 0.0620 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0620 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0416 - val_loss: 0.0620 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0412 - val_loss: 0.0620 - lr: 2.2603e-09
Average Validation Loss: 0.05875381305813789
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:22:25.005396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.005964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.006310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:25.063051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.063475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.063879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:25.146699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.147202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.147628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:25.209956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.210595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.211013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:25.446949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.447393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.447827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:25.505870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:25.506333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:25.506765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1210 - val_loss: 0.1117 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0613

2023-11-27 18:22:26.087814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:26.088239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:26.088815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:26.149907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:26.150354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:26.150744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1241 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1037 - val_loss: 0.1258 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1075 - val_loss: 0.1202 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 5ms/step - loss: 0.1001 - val_loss: 0.1152 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.1146 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.1154 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.1126 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.1107 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1119 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1107 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.1096 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.1072 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.1065 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.1076 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.1056 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.1057 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.1035 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.1046 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.1030 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.1031 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.1027 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.1017 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.1032 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.1024 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.1010 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.1007 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.1007 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.1000 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.1003 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.1005 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.1004 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.1004 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.1002 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.1002 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.1001 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.1000 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.1000 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.1000 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.1000 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.1000 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0511 - val_loss: 0.1000 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.1000 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.1000 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0525 - val_loss: 0.1000 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0500 - val_loss: 0.1000 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0503 - val_loss: 0.1000 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0515 - val_loss: 0.1000 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0512 - val_loss: 0.1000 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.1000 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.1000 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.1000 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.1000 - lr: 1.0130e-08
Epoch 54/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.1000 - lr: 6.1442e-09
Epoch 55/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.1000 - lr: 3.7267e-09
Epoch 56/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.1000 - lr: 2.2603e-09
Epoch 57/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0531 - val_loss: 0.1000 - lr: 1.3710e-09
Epoch 58/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.1000 - lr: 8.3153e-10
Epoch 59/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.1000 - lr: 5.0435e-10
Epoch 60/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.1000 - lr: 3.0590e-10
Epoch 61/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.1000 - lr: 1.6788e-10
Epoch 62/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.1000 - lr: 9.2136e-11
Epoch 63/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.1000 - lr: 5.0565e-11
Epoch 64/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.1000 - lr: 2.7751e-11
Epoch 65/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0506 - val_loss: 0.1000 - lr: 1.5230e-11
Epoch 66/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0495 - val_loss: 0.1000 - lr: 8.3584e-12
Epoch 67/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.1000 - lr: 4.5872e-12
Epoch 68/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.1000 - lr: 2.5175e-12
Epoch 69/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.1000 - lr: 1.3816e-12
Epoch 70/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.1000 - lr: 7.5826e-13
Epoch 71/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.1000 - lr: 3.7654e-13
Epoch 72/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.1000 - lr: 1.8698e-13
Epoch 73/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.1000 - lr: 9.2853e-14
Epoch 74/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.1000 - lr: 4.6110e-14
Epoch 75/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.1000 - lr: 2.2897e-14
Epoch 76/100
9/9 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.1000 - lr: 1.1370e-14
Epoch 1/100

2023-11-27 18:22:29.723717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:29.724091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:29.724655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:29.777572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:29.777966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:29.778315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:29.855530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:29.856028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:29.856448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:29.914537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:29.914980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:29.915385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:30.094565: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:30.095039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:30.095503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:30.152213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:30.152691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:30.153109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.1360 - val_loss: 0.0775 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0716

2023-11-27 18:22:30.618775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:30.619308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:30.619775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:30.680647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:30.681082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:30.681463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1139 - val_loss: 0.0749 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1113 - val_loss: 0.0719 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1078 - val_loss: 0.0647 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 3ms/step - loss: 0.1023 - val_loss: 0.0581 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.0612 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0943 - val_loss: 0.0581 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0890 - val_loss: 0.0598 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0862 - val_loss: 0.0693 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0819 - val_loss: 0.0667 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0646 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0768 - val_loss: 0.0635 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0712 - val_loss: 0.0614 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0644 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0664 - val_loss: 0.0676 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0663 - val_loss: 0.0619 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0656 - val_loss: 0.0609 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0645 - val_loss: 0.0587 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0633 - val_loss: 0.0618 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0626 - val_loss: 0.0671 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0649 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0619 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0612 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 3ms/step - loss: 0.0600 - val_loss: 0.0605 - lr: 1.3534e-04
Epoch 1/100

2023-11-27 18:22:32.211869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.212280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.212850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:32.265217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.265628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.266017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:32.345195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.345658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.346169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:32.407054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.407590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.408098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:32.650861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.651331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.651790: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:32.710910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:32.711387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:32.711798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1176 - val_loss: 0.1101 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0679

2023-11-27 18:22:33.377668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:33.378231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:33.378842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:33.439119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:33.439542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:33.439941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 4ms/step - loss: 0.1023 - val_loss: 0.1073 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0969 - val_loss: 0.0962 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0946 - val_loss: 0.0882 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0933 - val_loss: 0.0809 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0890 - val_loss: 0.0760 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.0697 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0764 - val_loss: 0.0622 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0629 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0686 - val_loss: 0.0546 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0559 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0637 - val_loss: 0.0553 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.0561 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0555 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0519 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0506 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0485 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0473 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0471 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0468 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0515 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0547 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0532 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0501 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0523 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0507 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0503 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0511 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0506 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0511 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0512 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0508 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0513 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0512 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0512 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0513 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0513 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0512 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0513 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:22:37.621034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:37.621527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:37.622044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:37.673146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:37.673513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:37.673918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:37.768985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:37.769462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:37.769946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:37.837328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:37.838135: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:37.838653: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:38.086413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:38.087063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:38.087510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:38.148950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:38.149468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:38.149911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1165 - val_loss: 0.0975 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0766

2023-11-27 18:22:38.831189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:38.831676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:38.832357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:38.893143: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:38.893578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:38.893965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.0949 - val_loss: 0.1116 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0915 - val_loss: 0.1067 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0868 - val_loss: 0.1062 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0821 - val_loss: 0.1033 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.1020 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0763 - val_loss: 0.1069 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.1069 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.1128 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.1150 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0797 - val_loss: 0.1165 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.1024 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0795 - val_loss: 0.0925 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0755 - val_loss: 0.0945 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0756 - val_loss: 0.0876 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0846 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0700 - val_loss: 0.0840 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0679 - val_loss: 0.0786 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0794 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0652 - val_loss: 0.0782 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.0736 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0695 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0657 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0638 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0637 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0636 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0629 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0626 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0622 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0620 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0616 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0616 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0616 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0616 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0615 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.0615 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0615 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0541 - val_loss: 0.0614 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0614 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0614 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0614 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0614 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0614 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0614 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0614 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0614 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0614 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0614 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0614 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0538 - val_loss: 0.0614 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0614 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0544 - val_loss: 0.0614 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0553 - val_loss: 0.0614 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0614 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0540 - val_loss: 0.0614 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0614 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0614 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0614 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0614 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0614 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0541 - val_loss: 0.0614 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.0614 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0614 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0614 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0546 - val_loss: 0.0614 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0539 - val_loss: 0.0614 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0539 - val_loss: 0.0614 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0547 - val_loss: 0.0614 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0548 - val_loss: 0.0614 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0542 - val_loss: 0.0614 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0543 - val_loss: 0.0614 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0614 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0614 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0551 - val_loss: 0.0614 - lr: 2.2897e-14
Epoch 1/100

2023-11-27 18:22:48.348215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.348709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.349149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:48.399703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.400076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.400408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:48.486785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.487662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.488403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:48.554268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.554960: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.555514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:48.791013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.791486: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.791935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:48.849947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:48.850412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:48.850828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1173 - val_loss: 0.0977 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0657

2023-11-27 18:22:49.550704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:49.551265: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:49.551761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:49.614176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:49.614628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:49.615017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 4ms/step - loss: 0.0999 - val_loss: 0.0917 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0881 - val_loss: 0.0879 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0812 - val_loss: 0.0853 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0814 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0747 - val_loss: 0.0783 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0786 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0711 - val_loss: 0.0759 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0780 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0670 - val_loss: 0.0742 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.0752 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0730 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0771 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0673 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0675 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0652 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0640 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0510 - val_loss: 0.0621 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0617 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0612 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0630 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0636 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0619 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0599 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0590 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0589 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0469 - val_loss: 0.0589 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0589 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0589 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0589 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0590 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0589 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0589 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0589 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0589 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0589 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0589 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0435 - val_loss: 0.0589 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0589 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0589 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0589 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0589 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0442 - val_loss: 0.0589 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0447 - val_loss: 0.0589 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0589 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0589 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0589 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0589 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0589 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0589 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0589 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0589 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0589 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0589 - lr: 1.3710e-09
Average Validation Loss: 0.06502923518419265
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:22:58.370493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.371047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.371409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:58.424912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.425298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.425668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:58.510477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.511268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.512010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:58.578748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.579421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.579858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:58.825393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.826492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.827442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:22:58.897200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:58.897781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:58.898217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 2s 66ms/step - loss: 0.1671 - val_loss: 0.1426 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0791

2023-11-27 18:22:59.973912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:22:59.974422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:22:59.975111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:00.036932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:00.037379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:00.037794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 9ms/step - loss: 0.1132 - val_loss: 0.1281 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1025 - val_loss: 0.1356 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1057 - val_loss: 0.1417 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 7ms/step - loss: 0.1066 - val_loss: 0.1421 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 8ms/step - loss: 0.1047 - val_loss: 0.1372 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1291 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0946 - val_loss: 0.1230 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0930 - val_loss: 0.1208 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0900 - val_loss: 0.1217 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0910 - val_loss: 0.1213 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0851 - val_loss: 0.1215 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.1206 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.1183 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0803 - val_loss: 0.1165 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0801 - val_loss: 0.1153 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.1141 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0716 - val_loss: 0.1143 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0706 - val_loss: 0.1130 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0727 - val_loss: 0.1127 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0701 - val_loss: 0.1112 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0656 - val_loss: 0.1113 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0664 - val_loss: 0.1117 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0620 - val_loss: 0.1115 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0636 - val_loss: 0.1106 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0627 - val_loss: 0.1103 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0625 - val_loss: 0.1110 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0629 - val_loss: 0.1121 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0637 - val_loss: 0.1126 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0630 - val_loss: 0.1126 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0611 - val_loss: 0.1126 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0600 - val_loss: 0.1126 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0627 - val_loss: 0.1126 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0612 - val_loss: 0.1125 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0606 - val_loss: 0.1125 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0615 - val_loss: 0.1125 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0607 - val_loss: 0.1125 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 8ms/step - loss: 0.0609 - val_loss: 0.1124 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0610 - val_loss: 0.1124 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0628 - val_loss: 0.1124 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0592 - val_loss: 0.1124 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0609 - val_loss: 0.1124 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0579 - val_loss: 0.1124 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0620 - val_loss: 0.1124 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0603 - val_loss: 0.1124 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 7ms/step - loss: 0.0595 - val_loss: 0.1124 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:23:01.784745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:01.785173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:01.785529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:01.838113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:01.838536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:01.838936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:01.918573: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:01.919044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:01.919478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:01.978731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:01.979166: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:01.979580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:02.231552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:02.232308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:02.232803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:02.296602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:02.297140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:02.297603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1751 - val_loss: 0.0937 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0818

2023-11-27 18:23:02.871949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:02.872428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:02.873081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:02.932885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:02.933310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:02.933758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1146 - val_loss: 0.0679 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1149 - val_loss: 0.0634 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1075 - val_loss: 0.0712 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1015 - val_loss: 0.0733 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0992 - val_loss: 0.0638 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0925 - val_loss: 0.0674 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0879 - val_loss: 0.0723 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0826 - val_loss: 0.0789 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0800 - val_loss: 0.0737 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0786 - val_loss: 0.0833 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0753 - val_loss: 0.0760 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0726 - val_loss: 0.0877 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0707 - val_loss: 0.0736 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0689 - val_loss: 0.0797 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0684 - val_loss: 0.0772 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0656 - val_loss: 0.0799 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0657 - val_loss: 0.0837 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0644 - val_loss: 0.0779 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0633 - val_loss: 0.0799 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0626 - val_loss: 0.0763 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0640 - val_loss: 0.0799 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0625 - val_loss: 0.0792 - lr: 2.0190e-04
Epoch 1/100

2023-11-27 18:23:04.219705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.220177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.220632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:04.271419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.271798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.272145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:04.353084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.353562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.353976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:04.413103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.413557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.413977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:04.644390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.644926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.645353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:04.703129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:04.703574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:04.703994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 25ms/step - loss: 0.1306 - val_loss: 0.1274 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1013

2023-11-27 18:23:05.320355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:05.320840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:05.321313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:05.382639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:05.383121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:05.383541: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 6ms/step - loss: 0.1120 - val_loss: 0.1171 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1061 - val_loss: 0.1183 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 6ms/step - loss: 0.1038 - val_loss: 0.1127 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0970 - val_loss: 0.1046 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0958 - val_loss: 0.1033 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0904 - val_loss: 0.0976 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0898 - val_loss: 0.0934 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0842 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0779 - val_loss: 0.0818 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0755 - val_loss: 0.0802 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0764 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0745 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0687 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0666 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0658 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0658 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0624 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0633 - val_loss: 0.0644 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0610 - val_loss: 0.0644 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0629 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0610 - val_loss: 0.0636 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0584 - val_loss: 0.0621 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0587 - val_loss: 0.0626 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0596 - val_loss: 0.0616 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0574 - val_loss: 0.0616 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0614 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0613 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0614 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0567 - val_loss: 0.0612 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0565 - val_loss: 0.0608 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0607 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0576 - val_loss: 0.0609 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0572 - val_loss: 0.0610 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0609 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0585 - val_loss: 0.0609 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0576 - val_loss: 0.0609 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0562 - val_loss: 0.0608 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0608 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0608 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0608 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0608 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0608 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0568 - val_loss: 0.0608 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0566 - val_loss: 0.0608 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0608 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0564 - val_loss: 0.0608 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0608 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0608 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0608 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0608 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 6ms/step - loss: 0.0576 - val_loss: 0.0608 - lr: 1.6702e-08
Epoch 1/100

2023-11-27 18:23:09.182735: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.183217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.183567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:09.237515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.237943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.238418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:09.322911: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.323400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.323838: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:09.383869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.384378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.384953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:09.619712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.620188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.620641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:09.679712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:09.680217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:09.680632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 20ms/step - loss: 0.1671 - val_loss: 0.1024 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0962

2023-11-27 18:23:10.314885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:10.315554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:10.316107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:10.379116: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:10.379576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:10.379986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1103 - val_loss: 0.1030 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1047 - val_loss: 0.0904 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0878 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0913 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0893 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0892 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0835 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0907 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.0936 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0805 - val_loss: 0.0778 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0698 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0688 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0678 - val_loss: 0.0760 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0745 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0613 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0547 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0613 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0622 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0620 - val_loss: 0.0552 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0437 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0429 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0547 - val_loss: 0.0421 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0400 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0400 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0395 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0392 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0403 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0391 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0390 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0389 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0515 - val_loss: 0.0388 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0391 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0523 - val_loss: 0.0389 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0388 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0388 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0388 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0388 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0387 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0387 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0387 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0387 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0387 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0387 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0387 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0387 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0387 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0387 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0387 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0387 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0387 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0387 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0387 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0387 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0387 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0387 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0523 - val_loss: 0.0387 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0387 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0387 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0387 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0518 - val_loss: 0.0387 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0387 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0514 - val_loss: 0.0387 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0387 - lr: 2.7751e-11
Epoch 1/100

2023-11-27 18:23:15.925198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:15.925610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:15.926077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:15.977796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:15.978177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:15.978525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:16.058771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:16.059261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:16.059705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:16.118968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:16.119453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:16.119874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:16.352314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:16.352889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:16.353302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:16.415142: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:16.415572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:16.415973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 16ms/step - loss: 0.1239 - val_loss: 0.1012 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1297

2023-11-27 18:23:17.059258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:17.059929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:17.060368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:17.121867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:17.122286: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:17.122680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 5ms/step - loss: 0.1051 - val_loss: 0.0950 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.0884 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0856 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0885 - val_loss: 0.0879 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.0890 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0855 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0811 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0802 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0802 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0795 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0786 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0678 - val_loss: 0.0762 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0658 - val_loss: 0.0722 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0698 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0671 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0621 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0625 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0589 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0544 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0520 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0517 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0509 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0505 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0500 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0500 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0499 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0499 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0497 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0498 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0497 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0497 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0498 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0498 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0498 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0497 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0497 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0497 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0497 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0497 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0497 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0497 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0497 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0497 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0497 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0497 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0497 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0497 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0497 - lr: 1.0130e-08
Average Validation Loss: 0.06456580311059952
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:23:22.649917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:22.650599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:22.651124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:22.708181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:22.708579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:22.708926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:22.788885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:22.789358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:22.789779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:22.849631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:22.850086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:22.850515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:23.083829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:23.084427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:23.084840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:23.142177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:23.142631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:23.143056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.2368 - val_loss: 0.2436 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2002

2023-11-27 18:23:23.767231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:23.767978: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:23.768453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:23.830966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:23.831432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:23.831833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.2174 - val_loss: 0.2294 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.2049 - val_loss: 0.2178 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1891 - val_loss: 0.2070 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1746 - val_loss: 0.2058 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1554 - val_loss: 0.2144 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1371 - val_loss: 0.2138 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1278 - val_loss: 0.1982 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1137 - val_loss: 0.1863 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1056 - val_loss: 0.1823 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1100 - val_loss: 0.1550 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1156 - val_loss: 0.1483 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1058 - val_loss: 0.1546 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.1687 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.1568 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0904 - val_loss: 0.1415 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0960 - val_loss: 0.1409 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0866 - val_loss: 0.1537 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0855 - val_loss: 0.1401 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1378 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.1365 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1464 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.1364 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.1407 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1365 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0777 - val_loss: 0.1386 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.1403 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0782 - val_loss: 0.1385 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.1355 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.1350 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.1391 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.1377 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.1374 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0756 - val_loss: 0.1356 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.1364 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.1372 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0752 - val_loss: 0.1373 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.1370 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.1370 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.1367 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0768 - val_loss: 0.1365 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.1365 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.1365 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.1365 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.1365 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.1365 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.1365 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.1365 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 6ms/step - loss: 0.0767 - val_loss: 0.1365 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.1365 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:23:28.194849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.195445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.195879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:28.250147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.250535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.250887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:28.332469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.332950: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.333362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:28.393081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.393576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.394019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:28.576145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.576648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.577080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:28.634202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:28.634644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:28.635073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.2522 - val_loss: 0.1963 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1507

2023-11-27 18:23:29.163936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:29.164552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:29.164959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:29.225771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:29.226221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:29.226617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.2261 - val_loss: 0.1650 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.2029 - val_loss: 0.1516 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1865 - val_loss: 0.1412 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1748 - val_loss: 0.1308 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1657 - val_loss: 0.1257 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1593 - val_loss: 0.1197 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1522 - val_loss: 0.1138 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1465 - val_loss: 0.1114 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1422 - val_loss: 0.1111 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1374 - val_loss: 0.1028 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1282 - val_loss: 0.1132 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1235 - val_loss: 0.1029 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1189 - val_loss: 0.1116 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1133 - val_loss: 0.1066 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1111 - val_loss: 0.1007 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1035 - val_loss: 0.1027 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1018 - val_loss: 0.0991 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0976 - val_loss: 0.0931 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0936 - val_loss: 0.0895 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0888 - val_loss: 0.0840 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0852 - val_loss: 0.0802 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0790 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0792 - val_loss: 0.0795 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0747 - val_loss: 0.0792 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0787 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0726 - val_loss: 0.0797 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0716 - val_loss: 0.0791 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0704 - val_loss: 0.0805 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0811 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0809 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0807 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0809 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0682 - val_loss: 0.0813 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0811 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0809 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0812 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0684 - val_loss: 0.0812 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0666 - val_loss: 0.0814 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0688 - val_loss: 0.0814 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0815 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0678 - val_loss: 0.0816 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0680 - val_loss: 0.0816 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0816 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0816 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0816 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:23:34.327079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.327626: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.327958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:34.383383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.383798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.384179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:34.469657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.470169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.470588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:34.533098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.533646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.534090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:34.769038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.769504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.769938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:34.828788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:34.829248: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:34.829662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.2282 - val_loss: 0.2063 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.2090

2023-11-27 18:23:35.562070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:35.562544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:35.563075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:35.624052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:35.624509: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:35.624903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1932 - val_loss: 0.1784 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1719 - val_loss: 0.1594 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1549 - val_loss: 0.1442 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1457 - val_loss: 0.1363 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1368 - val_loss: 0.1288 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1311 - val_loss: 0.1270 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1274 - val_loss: 0.1201 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1191 - val_loss: 0.1166 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1145 - val_loss: 0.1118 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1081 - val_loss: 0.1031 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1078 - val_loss: 0.1064 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1014 - val_loss: 0.0960 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0931 - val_loss: 0.0926 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.0868 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0829 - val_loss: 0.0819 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.0766 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0741 - val_loss: 0.0749 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0735 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0726 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0680 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0690 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0677 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0628 - val_loss: 0.0668 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0637 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0648 - val_loss: 0.0646 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0656 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0614 - val_loss: 0.0655 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0663 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0667 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0674 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0670 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0668 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0667 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0667 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0584 - val_loss: 0.0666 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0667 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0667 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0668 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0668 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0668 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0667 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0667 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0667 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:23:44.409827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.410350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.410688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:44.464470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.464913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.465356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:44.548655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.549198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.549656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:44.609558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.610038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.610471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:44.854881: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.856187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.856769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:44.920002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:44.920538: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:44.921042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 2s 8ms/step - loss: 0.2288 - val_loss: 0.2149 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2244

2023-11-27 18:23:46.274499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:46.274986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:46.275540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:23:46.337505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:23:46.337952: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:23:46.338325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1879 - val_loss: 0.1733 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1627 - val_loss: 0.1574 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1483 - val_loss: 0.1450 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1379 - val_loss: 0.1295 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1285 - val_loss: 0.1228 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1195 - val_loss: 0.1154 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1133 - val_loss: 0.1102 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1073 - val_loss: 0.1034 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.0994 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0936 - val_loss: 0.0996 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0875 - val_loss: 0.0974 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0835 - val_loss: 0.0889 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0852 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0832 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0740 - val_loss: 0.0799 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0781 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0701 - val_loss: 0.0769 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0763 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0653 - val_loss: 0.0756 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0643 - val_loss: 0.0738 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0746 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0741 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0730 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0615 - val_loss: 0.0726 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0698 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0683 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0658 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0643 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0625 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0617 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0607 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0600 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0598 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0596 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0595 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0594 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0594 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0594 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0593 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0593 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0593 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0593 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0593 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0593 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0593 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0593 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0593 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0593 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0593 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0593 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0593 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0552 - val_loss: 0.0593 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0593 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0593 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0593 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0593 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0593 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0593 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0593 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0593 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0593 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0593 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0593 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0593 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0593 - lr: 1.3924e-15
Epoch 1/100

2023-11-27 18:24:06.490830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:06.491497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:06.492103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:06.551013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:06.551383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:06.551750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:06.645194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:06.645646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:06.646086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:06.710937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:06.711474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:06.712139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:06.956100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:06.956724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:06.957156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:07.017547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:07.018078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:07.018519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 2s 7ms/step - loss: 0.2201 - val_loss: 0.1824 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1449

2023-11-27 18:24:07.910115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:07.910615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:07.911193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:07.973592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:07.974058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:07.974446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 3ms/step - loss: 0.1711 - val_loss: 0.1525 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1464 - val_loss: 0.1376 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1295 - val_loss: 0.1281 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1189 - val_loss: 0.1247 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1116 - val_loss: 0.1183 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1025 - val_loss: 0.1128 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0972 - val_loss: 0.1043 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0882 - val_loss: 0.0998 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0816 - val_loss: 0.0960 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0801 - val_loss: 0.0938 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.0955 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.0925 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0710 - val_loss: 0.0917 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0700 - val_loss: 0.0880 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0880 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0850 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0630 - val_loss: 0.0812 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0809 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0791 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0746 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0745 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0742 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0737 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0733 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0494 - val_loss: 0.0733 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0730 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0725 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0722 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0721 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0719 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0718 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0718 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0717 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0717 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0717 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0717 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0716 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0716 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0716 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0716 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0716 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0716 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0716 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0716 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0716 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0716 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0716 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0716 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0716 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0716 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0716 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0716 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0716 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0716 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0716 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0716 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0716 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0716 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0716 - lr: 1.3960e-16
Epoch 83/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0716 - lr: 6.2726e-17
Epoch 84/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0474 - val_loss: 0.0716 - lr: 2.8185e-17
Epoch 85/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 1.2664e-17
Epoch 86/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0716 - lr: 5.6904e-18
Average Validation Loss: 0.08184570074081421
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:24:35.427750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.428712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.429363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:35.493199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.493746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.494212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:35.588069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.588550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.588975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:35.655303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.655860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.656415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:35.926466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.927110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.927551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:35.995090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:35.995572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:35.996016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 40ms/step - loss: 0.2416 - val_loss: 0.2682 - lr: 0.0010
Epoch 2/100

2023-11-27 18:24:36.637829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:36.638355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:36.639054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:36.708480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:36.708965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:36.709349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 8ms/step - loss: 0.2334 - val_loss: 0.2566 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2240 - val_loss: 0.2264 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2060 - val_loss: 0.2187 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1929 - val_loss: 0.2161 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1872 - val_loss: 0.2051 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1765 - val_loss: 0.1941 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1628 - val_loss: 0.1860 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1504 - val_loss: 0.1809 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1411 - val_loss: 0.1746 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1326 - val_loss: 0.1706 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1225 - val_loss: 0.1766 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1216 - val_loss: 0.1706 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1180 - val_loss: 0.1639 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1121 - val_loss: 0.1621 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1096 - val_loss: 0.1633 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1093 - val_loss: 0.1571 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1043 - val_loss: 0.1599 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1059 - val_loss: 0.1532 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1030 - val_loss: 0.1564 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1011 - val_loss: 0.1540 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0998 - val_loss: 0.1551 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1015 - val_loss: 0.1510 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0980 - val_loss: 0.1520 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1514 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0991 - val_loss: 0.1498 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0987 - val_loss: 0.1490 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0976 - val_loss: 0.1505 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0970 - val_loss: 0.1495 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0986 - val_loss: 0.1488 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0978 - val_loss: 0.1488 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.1488 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0983 - val_loss: 0.1485 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0963 - val_loss: 0.1489 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0964 - val_loss: 0.1494 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0962 - val_loss: 0.1495 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0973 - val_loss: 0.1494 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0974 - val_loss: 0.1493 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0966 - val_loss: 0.1493 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0964 - val_loss: 0.1494 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0978 - val_loss: 0.1494 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0964 - val_loss: 0.1494 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0970 - val_loss: 0.1494 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0974 - val_loss: 0.1494 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0971 - val_loss: 0.1494 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0967 - val_loss: 0.1494 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0981 - val_loss: 0.1494 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0975 - val_loss: 0.1494 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0982 - val_loss: 0.1494 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0956 - val_loss: 0.1494 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0970 - val_loss: 0.1494 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0971 - val_loss: 0.1494 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0977 - val_loss: 0.1494 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:24:40.066223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.067261: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.067743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:40.125520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.125917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.126254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:40.203529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.204006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.204387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:40.264328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.264796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.265229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:40.448641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.449120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.449616: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:40.506807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.507276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.507684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.2591 - val_loss: 0.1856 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1926

2023-11-27 18:24:40.984681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:40.985182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:40.985867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:41.047793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:41.048243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:41.048647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.2297 - val_loss: 0.1880 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2087 - val_loss: 0.1639 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1963 - val_loss: 0.1522 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1831 - val_loss: 0.1490 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1719 - val_loss: 0.1449 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1647 - val_loss: 0.1297 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1524 - val_loss: 0.1338 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1419 - val_loss: 0.1450 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1465 - val_loss: 0.1109 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1357 - val_loss: 0.1147 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1217 - val_loss: 0.1214 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1166 - val_loss: 0.1196 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1147 - val_loss: 0.1119 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1127 - val_loss: 0.1017 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1086 - val_loss: 0.0991 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1026 - val_loss: 0.1015 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0984 - val_loss: 0.1041 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0961 - val_loss: 0.1055 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0967 - val_loss: 0.1024 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.1002 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0997 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0898 - val_loss: 0.1001 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0892 - val_loss: 0.1008 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0886 - val_loss: 0.0998 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0994 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0869 - val_loss: 0.1002 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.0995 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0863 - val_loss: 0.0998 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0999 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.1002 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0850 - val_loss: 0.0998 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.1007 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.1005 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0854 - val_loss: 0.1003 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0855 - val_loss: 0.1003 - lr: 8.2297e-06
Epoch 1/100

2023-11-27 18:24:43.889451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:43.890004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:43.890380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:43.943974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:43.944335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:43.944719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:44.024021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:44.024498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:44.024921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:44.084874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:44.085358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:44.085781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:44.330162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:44.330624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:44.331156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:44.389264: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:44.389720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:44.390145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.2335 - val_loss: 0.2190 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1608

2023-11-27 18:24:45.051282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:45.051758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:45.052424: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:45.113361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:45.113782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:45.114160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.2045 - val_loss: 0.1906 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1861 - val_loss: 0.1711 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1696 - val_loss: 0.1533 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1571 - val_loss: 0.1409 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1468 - val_loss: 0.1364 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1402 - val_loss: 0.1253 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1278 - val_loss: 0.1208 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1196 - val_loss: 0.1146 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1148 - val_loss: 0.1075 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1077 - val_loss: 0.1046 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1022 - val_loss: 0.0954 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0988 - val_loss: 0.0975 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.0899 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.0895 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0937 - val_loss: 0.0864 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.0809 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.0783 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0766 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.0757 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.0781 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.0805 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0800 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0774 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0774 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0769 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0771 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0760 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0766 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0761 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0703 - val_loss: 0.0756 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0762 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0761 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0761 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0760 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0759 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0759 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0759 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0759 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0759 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0759 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0759 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0759 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0759 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0759 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0759 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0759 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0759 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0695 - val_loss: 0.0759 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0759 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0759 - lr: 1.6702e-08
Epoch 1/100

2023-11-27 18:24:51.950273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:51.950689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:51.951068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:52.004054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:52.004445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:52.004793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:52.086071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:52.086563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:52.087004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:52.146413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:52.146891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:52.147327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:52.379904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:52.380365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:52.380905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:52.439157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:52.439605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:52.440038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.2350 - val_loss: 0.2080 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1627

2023-11-27 18:24:53.139646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:53.140358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:53.140747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:24:53.200732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:24:53.201171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:24:53.201554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1977 - val_loss: 0.1968 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1790 - val_loss: 0.1861 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1585 - val_loss: 0.1732 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1464 - val_loss: 0.1535 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1341 - val_loss: 0.1322 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1252 - val_loss: 0.1268 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1148 - val_loss: 0.1139 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1070 - val_loss: 0.1147 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1010 - val_loss: 0.1027 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.1023 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0915 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0979 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0933 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0926 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.0905 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0778 - val_loss: 0.0914 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0913 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0967 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0989 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.1150 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.1119 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0880 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.0840 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0785 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0744 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0729 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0721 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0709 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0695 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0692 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0696 - val_loss: 0.0689 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0691 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0688 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0686 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0686 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0686 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0686 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 6ms/step - loss: 0.0685 - val_loss: 0.0685 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0685 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0685 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0684 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0684 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0684 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0684 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0684 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0684 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0677 - val_loss: 0.0684 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0684 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0684 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0685 - val_loss: 0.0684 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0684 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0684 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0684 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0684 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0684 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0684 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0684 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0686 - val_loss: 0.0684 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0684 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0684 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0684 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0678 - val_loss: 0.0684 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0682 - val_loss: 0.0684 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0684 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0684 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0683 - val_loss: 0.0684 - lr: 4.5872e-12
Epoch 1/100

2023-11-27 18:25:04.255453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.255874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.256386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:04.312073: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.312542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.312928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:04.396326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.396755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.397170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:04.456388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.456927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.457528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:04.694047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.694627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.695140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:04.753108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:04.753572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:04.753981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 11ms/step - loss: 0.2335 - val_loss: 0.2048 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1568

2023-11-27 18:25:05.506407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:05.506832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:05.507474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:05.568296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:05.568737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:05.569118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1889 - val_loss: 0.1765 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1626 - val_loss: 0.1596 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1442 - val_loss: 0.1476 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1312 - val_loss: 0.1405 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1202 - val_loss: 0.1312 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1118 - val_loss: 0.1272 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.1227 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1044 - val_loss: 0.1188 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1013 - val_loss: 0.1152 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1113 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.1072 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.1041 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.1009 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0993 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0964 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0939 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0924 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0910 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0693 - val_loss: 0.0891 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0674 - val_loss: 0.0879 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0877 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0869 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0636 - val_loss: 0.0865 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0862 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0855 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0855 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0622 - val_loss: 0.0849 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0842 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0836 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0831 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0829 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0827 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0826 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0824 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0824 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0823 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0823 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0823 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0823 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0823 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0823 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0823 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0823 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0823 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0822 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0822 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0822 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0822 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0822 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0822 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0822 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0822 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0822 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0822 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0822 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0822 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0822 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0822 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0822 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0822 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0822 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0822 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0822 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0822 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0822 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0822 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0822 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0822 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0822 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0822 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0822 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0822 - lr: 2.8039e-15
Average Validation Loss: 0.09477908611297607
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:25:21.083040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.083416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.083762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:21.142905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.143301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.143698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:21.226944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.227446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.227866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:21.288854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.289419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.289869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:21.527885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.528324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.528712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:21.597516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:21.598033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:21.598430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.2472 - val_loss: 0.2579 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.2471

2023-11-27 18:25:22.158940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:22.159443: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:22.159869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:22.220385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:22.220808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:22.221190: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.2303 - val_loss: 0.2751 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2366 - val_loss: 0.2696 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2309 - val_loss: 0.2539 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2187 - val_loss: 0.2379 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2133 - val_loss: 0.2274 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2045 - val_loss: 0.2222 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1950 - val_loss: 0.2211 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1903 - val_loss: 0.2234 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1839 - val_loss: 0.2210 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1795 - val_loss: 0.2105 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1705 - val_loss: 0.2045 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1604 - val_loss: 0.2020 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1521 - val_loss: 0.1992 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1477 - val_loss: 0.1896 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1400 - val_loss: 0.1902 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1370 - val_loss: 0.1885 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1347 - val_loss: 0.1872 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1318 - val_loss: 0.1807 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1282 - val_loss: 0.1856 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1278 - val_loss: 0.1775 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1279 - val_loss: 0.1731 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1244 - val_loss: 0.1814 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1252 - val_loss: 0.1799 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1239 - val_loss: 0.1748 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1226 - val_loss: 0.1735 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1242 - val_loss: 0.1755 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1755 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1228 - val_loss: 0.1755 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1218 - val_loss: 0.1752 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1233 - val_loss: 0.1750 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1217 - val_loss: 0.1745 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1217 - val_loss: 0.1739 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1213 - val_loss: 0.1738 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1213 - val_loss: 0.1737 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1213 - val_loss: 0.1737 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1221 - val_loss: 0.1738 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1211 - val_loss: 0.1738 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1737 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1212 - val_loss: 0.1737 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1737 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1217 - val_loss: 0.1737 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:25:24.293731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:24.294303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:24.294680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:24.347191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:24.347558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:24.347909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:24.426847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:24.427312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:24.427795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:24.487532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:24.487991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:24.488418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:24.720444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:24.721012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:24.721464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:25.296377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:25.296847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:25.297431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 2s 36ms/step - loss: 0.2774 - val_loss: 0.2013 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2295

2023-11-27 18:25:25.877641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:25.878064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:25.878815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:25.939149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:25.939584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:25.939965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.2400 - val_loss: 0.1890 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2210 - val_loss: 0.1944 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2053 - val_loss: 0.1793 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1904 - val_loss: 0.1766 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1787 - val_loss: 0.1659 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1638 - val_loss: 0.1690 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1578 - val_loss: 0.1663 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1530 - val_loss: 0.1607 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1449 - val_loss: 0.1460 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1383 - val_loss: 0.1426 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1312 - val_loss: 0.1462 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1283 - val_loss: 0.1420 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1255 - val_loss: 0.1290 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1190 - val_loss: 0.1264 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1169 - val_loss: 0.1328 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1145 - val_loss: 0.1280 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1124 - val_loss: 0.1265 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1105 - val_loss: 0.1200 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1076 - val_loss: 0.1164 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1051 - val_loss: 0.1203 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1048 - val_loss: 0.1164 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1024 - val_loss: 0.1184 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1037 - val_loss: 0.1142 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1190 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1124 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1007 - val_loss: 0.1194 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1013 - val_loss: 0.1148 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1004 - val_loss: 0.1124 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0993 - val_loss: 0.1134 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1002 - val_loss: 0.1149 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1000 - val_loss: 0.1141 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0992 - val_loss: 0.1135 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.1135 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1001 - val_loss: 0.1138 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0998 - val_loss: 0.1140 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1000 - val_loss: 0.1141 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0996 - val_loss: 0.1140 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1140 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0994 - val_loss: 0.1141 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0988 - val_loss: 0.1141 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0986 - val_loss: 0.1141 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0982 - val_loss: 0.1141 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1141 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0984 - val_loss: 0.1141 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0985 - val_loss: 0.1141 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0988 - val_loss: 0.1141 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0989 - val_loss: 0.1141 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0985 - val_loss: 0.1141 - lr: 6.7729e-08
Epoch 1/100

2023-11-27 18:25:29.671079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:29.671633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:29.671936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:29.722281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:29.722658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:29.722997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:29.803024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:29.803570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:29.803977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:29.863899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:29.864364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:29.864828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:30.096753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:30.097314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:30.097757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:30.155999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:30.156451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:30.156872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 28ms/step - loss: 0.2347 - val_loss: 0.2336 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2234

2023-11-27 18:25:30.775751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:30.776303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:30.776900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:30.839289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:30.839762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:30.840172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.2180 - val_loss: 0.2171 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1980 - val_loss: 0.2017 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1878 - val_loss: 0.1789 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1772 - val_loss: 0.1729 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1625 - val_loss: 0.1595 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1536 - val_loss: 0.1466 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1461 - val_loss: 0.1404 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1403 - val_loss: 0.1334 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1362 - val_loss: 0.1318 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1244 - val_loss: 0.1271 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1158 - val_loss: 0.1176 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1090 - val_loss: 0.1142 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1046 - val_loss: 0.1080 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1006 - val_loss: 0.1048 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1031 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0968 - val_loss: 0.0970 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1012 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1006 - val_loss: 0.1054 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1036 - val_loss: 0.0986 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0967 - val_loss: 0.0998 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0917 - val_loss: 0.0945 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0903 - val_loss: 0.0941 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0889 - val_loss: 0.0926 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0878 - val_loss: 0.0919 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0884 - val_loss: 0.0919 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0884 - val_loss: 0.0918 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0876 - val_loss: 0.0920 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.0911 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0875 - val_loss: 0.0913 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0860 - val_loss: 0.0908 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0911 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0909 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0869 - val_loss: 0.0907 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0907 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0855 - val_loss: 0.0906 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.0907 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0868 - val_loss: 0.0907 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0907 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0907 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0907 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0907 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0859 - val_loss: 0.0907 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0907 - lr: 1.3710e-09
Epoch 1/100

2023-11-27 18:25:36.519095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:36.519535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:36.519904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:36.571692: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:36.572091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:36.572465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:36.656072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:36.656554: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:36.656974: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:36.716158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:36.716635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:36.717054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:36.952472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:36.952989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:36.953597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:37.013600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:37.014071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:37.014510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 22ms/step - loss: 0.2422 - val_loss: 0.2225 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2409

2023-11-27 18:25:37.678694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:37.679118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:37.679768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:37.740841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:37.741272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:37.741656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 7ms/step - loss: 0.2163 - val_loss: 0.2096 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1975 - val_loss: 0.1986 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1832 - val_loss: 0.2035 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1775 - val_loss: 0.2001 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1704 - val_loss: 0.1640 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1542 - val_loss: 0.1548 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1422 - val_loss: 0.1693 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1440 - val_loss: 0.1827 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1476 - val_loss: 0.1361 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1272 - val_loss: 0.1333 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1197 - val_loss: 0.1442 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1233 - val_loss: 0.1460 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1238 - val_loss: 0.1181 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1109 - val_loss: 0.1186 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1083 - val_loss: 0.1217 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1079 - val_loss: 0.1162 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1058 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1018 - val_loss: 0.1068 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0978 - val_loss: 0.1060 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0967 - val_loss: 0.1025 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0953 - val_loss: 0.0985 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0915 - val_loss: 0.0993 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0920 - val_loss: 0.0957 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0896 - val_loss: 0.0954 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0900 - val_loss: 0.0952 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0891 - val_loss: 0.0928 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0889 - val_loss: 0.0935 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0886 - val_loss: 0.0927 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0879 - val_loss: 0.0918 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0917 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0878 - val_loss: 0.0916 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0880 - val_loss: 0.0917 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0877 - val_loss: 0.0915 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.0913 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0872 - val_loss: 0.0913 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.0913 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0872 - val_loss: 0.0912 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0866 - val_loss: 0.0913 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0865 - val_loss: 0.0912 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.0912 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0912 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0912 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0873 - val_loss: 0.0912 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0868 - val_loss: 0.0912 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0912 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0912 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0873 - val_loss: 0.0912 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.0912 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0866 - val_loss: 0.0912 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0876 - val_loss: 0.0912 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0875 - val_loss: 0.0912 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0875 - val_loss: 0.0912 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0912 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.0912 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0912 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0912 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.0912 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0912 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0876 - val_loss: 0.0912 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0865 - val_loss: 0.0912 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0912 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0866 - val_loss: 0.0912 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0875 - val_loss: 0.0912 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0879 - val_loss: 0.0912 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0869 - val_loss: 0.0912 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0912 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0875 - val_loss: 0.0912 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0876 - val_loss: 0.0912 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.0912 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0875 - val_loss: 0.0912 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.0912 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0870 - val_loss: 0.0912 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0872 - val_loss: 0.0912 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0912 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0912 - lr: 1.1370e-14
Epoch 77/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0870 - val_loss: 0.0912 - lr: 5.6464e-15
Epoch 1/100

2023-11-27 18:25:47.407578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.408078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.408602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:47.467006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.467413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.467743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:47.548986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.549519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.549937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:47.609765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.610421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.610957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:47.860449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.860917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.861374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:47.919293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:47.919759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:47.920185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 18ms/step - loss: 0.2435 - val_loss: 0.2165 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2131

2023-11-27 18:25:48.581335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:48.581842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:48.582328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:25:48.641846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:25:48.642299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:25:48.642680: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.2107 - val_loss: 0.2012 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1963 - val_loss: 0.1891 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1789 - val_loss: 0.1726 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1626 - val_loss: 0.1556 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1530 - val_loss: 0.1525 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1474 - val_loss: 0.1470 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1363 - val_loss: 0.1394 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1309 - val_loss: 0.1350 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1272 - val_loss: 0.1318 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1194 - val_loss: 0.1241 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1116 - val_loss: 0.1202 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1081 - val_loss: 0.1195 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1036 - val_loss: 0.1155 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0996 - val_loss: 0.1106 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0958 - val_loss: 0.1088 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0926 - val_loss: 0.1057 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0891 - val_loss: 0.1022 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.1003 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0848 - val_loss: 0.1016 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0846 - val_loss: 0.1005 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0836 - val_loss: 0.0966 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0803 - val_loss: 0.0902 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0780 - val_loss: 0.0876 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0862 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0751 - val_loss: 0.0857 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0846 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0839 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0739 - val_loss: 0.0837 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0732 - val_loss: 0.0833 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0738 - val_loss: 0.0830 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0730 - val_loss: 0.0827 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0828 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0826 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0825 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0825 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0720 - val_loss: 0.0825 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0726 - val_loss: 0.0825 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0825 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0824 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0726 - val_loss: 0.0824 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0726 - val_loss: 0.0824 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0824 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0824 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0725 - val_loss: 0.0824 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.0824 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0730 - val_loss: 0.0824 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0722 - val_loss: 0.0824 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0726 - val_loss: 0.0824 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.0824 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.0824 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0722 - val_loss: 0.0824 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0824 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0730 - val_loss: 0.0824 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0717 - val_loss: 0.0824 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0722 - val_loss: 0.0824 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0723 - val_loss: 0.0824 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0824 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0719 - val_loss: 0.0824 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0722 - val_loss: 0.0824 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0715 - val_loss: 0.0824 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0726 - val_loss: 0.0824 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0722 - val_loss: 0.0824 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0727 - val_loss: 0.0824 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0729 - val_loss: 0.0824 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0731 - val_loss: 0.0824 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0729 - val_loss: 0.0824 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.0824 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0720 - val_loss: 0.0824 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0728 - val_loss: 0.0824 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0727 - val_loss: 0.0824 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0723 - val_loss: 0.0824 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0716 - val_loss: 0.0824 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0729 - val_loss: 0.0824 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0727 - val_loss: 0.0824 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0727 - val_loss: 0.0824 - lr: 1.1370e-14
Average Validation Loss: 0.1099440649151802
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:26:00.534320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:00.534757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:00.535364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:00.593066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:00.593460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:00.593818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:00.674224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:00.674720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:00.675139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:00.735457: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:00.736068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:00.736595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:00.978041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:00.978884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:00.979882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:01.046500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:01.047046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:01.047516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.2070 - val_loss: 0.2627 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2511

2023-11-27 18:26:01.657834: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:01.658309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:01.658889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:01.718531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:01.718962: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:01.719347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.2300 - val_loss: 0.2137 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1976 - val_loss: 0.2069 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1856 - val_loss: 0.1978 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1713 - val_loss: 0.1947 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1718 - val_loss: 0.1837 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1593 - val_loss: 0.1806 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1495 - val_loss: 0.1757 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1380 - val_loss: 0.1811 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 4ms/step - loss: 0.1249 - val_loss: 0.2004 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1367 - val_loss: 0.1609 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1142 - val_loss: 0.1523 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1094 - val_loss: 0.1582 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1010 - val_loss: 0.1444 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.1555 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0913 - val_loss: 0.1631 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0923 - val_loss: 0.1371 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0860 - val_loss: 0.1368 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.1379 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0804 - val_loss: 0.1472 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0806 - val_loss: 0.1434 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0786 - val_loss: 0.1366 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0774 - val_loss: 0.1411 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0753 - val_loss: 0.1418 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0755 - val_loss: 0.1387 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.1358 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.1344 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.1335 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.1362 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.1353 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.1343 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.1370 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.1371 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0744 - val_loss: 0.1370 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0726 - val_loss: 0.1369 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0720 - val_loss: 0.1361 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.1362 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.1362 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.1359 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.1358 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.1358 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0729 - val_loss: 0.1357 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.1356 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.1356 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.1356 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.1356 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.1356 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0728 - val_loss: 0.1356 - lr: 1.0104e-07
Epoch 1/100

2023-11-27 18:26:05.793191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:05.793766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:05.794158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:05.849203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:05.849609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:05.849947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:05.930696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:05.931178: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:05.931593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:05.990954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:05.991409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:05.991862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:06.172993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:06.173455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:06.173885: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:06.231374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:06.231821: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:06.232259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 10ms/step - loss: 0.2392 - val_loss: 0.1749 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1584

2023-11-27 18:26:06.741014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:06.741479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:06.741959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:06.802401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:06.802875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:06.803283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.2137 - val_loss: 0.1580 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1912 - val_loss: 0.1467 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1806 - val_loss: 0.1370 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1675 - val_loss: 0.1275 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1609 - val_loss: 0.1166 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1522 - val_loss: 0.1113 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1416 - val_loss: 0.1288 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1377 - val_loss: 0.1025 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1375 - val_loss: 0.1187 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1301 - val_loss: 0.0931 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1220 - val_loss: 0.1186 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1179 - val_loss: 0.0909 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1145 - val_loss: 0.1039 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1009 - val_loss: 0.1059 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1031 - val_loss: 0.0926 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1011 - val_loss: 0.0927 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0933 - val_loss: 0.0903 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0909 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0853 - val_loss: 0.0881 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0828 - val_loss: 0.0828 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0781 - val_loss: 0.0843 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0786 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0751 - val_loss: 0.0831 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0730 - val_loss: 0.0831 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0845 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0709 - val_loss: 0.0831 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0856 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0852 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0691 - val_loss: 0.0852 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0864 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0855 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0865 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0687 - val_loss: 0.0865 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0697 - val_loss: 0.0862 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0862 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0690 - val_loss: 0.0867 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0683 - val_loss: 0.0866 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0679 - val_loss: 0.0866 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0866 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0685 - val_loss: 0.0866 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0866 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0866 - lr: 7.4659e-07
Epoch 1/100

2023-11-27 18:26:11.557229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:11.557772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:11.558159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:11.614923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:11.615290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:11.615631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:11.698470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:11.698965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:11.699386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:11.760200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:11.760766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:11.761146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:11.998779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:11.999318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:11.999933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:12.058673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:12.059126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:12.059593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

49/51 [===========================>..] - ETA: 0s - loss: 0.2241

2023-11-27 18:26:12.835579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:12.836224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:12.836835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:12.914456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:12.915029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:12.915607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 10ms/step - loss: 0.2221 - val_loss: 0.1958 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1932 - val_loss: 0.1714 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1727 - val_loss: 0.1518 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1588 - val_loss: 0.1415 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1478 - val_loss: 0.1290 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1423 - val_loss: 0.1271 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1350 - val_loss: 0.1202 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1266 - val_loss: 0.1157 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1232 - val_loss: 0.1097 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1200 - val_loss: 0.1109 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1121 - val_loss: 0.1004 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1055 - val_loss: 0.0975 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0984 - val_loss: 0.0916 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0903 - val_loss: 0.0786 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0871 - val_loss: 0.0825 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0825 - val_loss: 0.0746 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0757 - val_loss: 0.0744 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0730 - val_loss: 0.0702 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0702 - val_loss: 0.0690 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0698 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0672 - val_loss: 0.0673 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0676 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0662 - val_loss: 0.0656 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0646 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0644 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0652 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0672 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0630 - val_loss: 0.0682 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0678 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0682 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0685 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0614 - val_loss: 0.0691 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0687 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0603 - val_loss: 0.0686 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0600 - val_loss: 0.0686 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0686 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0687 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0687 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0687 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0686 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0686 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0686 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0597 - val_loss: 0.0686 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0686 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0686 - lr: 3.3546e-07
Epoch 1/100

2023-11-27 18:26:21.808688: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:21.809120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:21.809715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:21.864841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:21.865282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:21.865656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:21.949230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:21.949784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:21.950282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:22.009662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:22.010141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:22.010602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:22.244239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:22.244708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:22.245257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:22.304095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:22.304551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:22.304957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 7ms/step - loss: 0.2199 - val_loss: 0.2160 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2219

2023-11-27 18:26:23.113652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:23.114154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:23.114699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:23.174320: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:23.174755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:23.175307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1782 - val_loss: 0.1653 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1553 - val_loss: 0.1523 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1427 - val_loss: 0.1417 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1340 - val_loss: 0.1277 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 3ms/step - loss: 0.1275 - val_loss: 0.1220 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1219 - val_loss: 0.1240 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1190 - val_loss: 0.1155 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1137 - val_loss: 0.1071 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1084 - val_loss: 0.1058 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1026 - val_loss: 0.1002 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0991 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0886 - val_loss: 0.0958 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0867 - val_loss: 0.0905 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0814 - val_loss: 0.0938 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0794 - val_loss: 0.0904 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0887 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0734 - val_loss: 0.0848 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.0812 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0786 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0784 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0641 - val_loss: 0.0771 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0624 - val_loss: 0.0768 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0766 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0742 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0714 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0708 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0673 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0597 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0638 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0577 - val_loss: 0.0619 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0606 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0572 - val_loss: 0.0600 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0596 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0597 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0596 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0596 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0595 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0594 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0594 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0561 - val_loss: 0.0595 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0595 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0594 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0594 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0594 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0594 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0594 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0594 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0594 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0594 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0594 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0594 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0594 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0554 - val_loss: 0.0594 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0594 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0594 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0558 - val_loss: 0.0594 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0564 - val_loss: 0.0594 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0594 - lr: 3.0590e-10
Epoch 1/100

2023-11-27 18:26:37.862842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:37.863220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:37.863580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:37.921953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:37.922296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:37.922652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:38.009434: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:38.010303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:38.010836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:38.077009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:38.077557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:38.077976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:38.827708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:38.828832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:38.829929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:38.895592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:38.896104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:38.896540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 2s 7ms/step - loss: 0.2074 - val_loss: 0.1694 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1261

2023-11-27 18:26:39.747275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:39.747721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:39.748381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:26:39.809503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:26:39.809938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:26:39.810334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1658 - val_loss: 0.1414 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1431 - val_loss: 0.1298 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1321 - val_loss: 0.1215 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1202 - val_loss: 0.1146 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1119 - val_loss: 0.1117 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1074 - val_loss: 0.1069 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1017 - val_loss: 0.1032 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0970 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0912 - val_loss: 0.0922 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0836 - val_loss: 0.0869 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0765 - val_loss: 0.0831 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0722 - val_loss: 0.0820 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0801 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0668 - val_loss: 0.0789 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0765 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0642 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0614 - val_loss: 0.0757 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0596 - val_loss: 0.0732 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0722 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0575 - val_loss: 0.0699 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0549 - val_loss: 0.0694 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0537 - val_loss: 0.0666 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0651 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0638 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0634 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0634 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0631 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0629 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0626 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0625 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0618 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0616 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0613 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0612 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0466 - val_loss: 0.0611 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0610 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0462 - val_loss: 0.0609 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0609 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0464 - val_loss: 0.0609 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0609 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0609 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0608 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0608 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0608 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0608 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0608 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0608 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0454 - val_loss: 0.0608 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0608 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0608 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0608 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0608 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0608 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0608 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0608 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0608 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0608 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0608 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0608 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0608 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0608 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0458 - val_loss: 0.0608 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0608 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0608 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0608 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0461 - val_loss: 0.0608 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0462 - val_loss: 0.0608 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0608 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0608 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0608 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0608 - lr: 1.3960e-16
Epoch 83/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0608 - lr: 6.2726e-17
Epoch 84/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0608 - lr: 2.8185e-17
Average Validation Loss: 0.08009184971451759
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:27:04.854036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:04.854571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:04.855068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:04.908718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:04.909140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:04.909490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:04.988452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:04.988934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:04.989342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:05.047907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:05.048344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:05.048771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:05.279693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:05.280149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:05.280587: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:05.337617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:05.338068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:05.338491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.2126 - val_loss: 0.2483 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1931

2023-11-27 18:27:05.927817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:05.928476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:05.928833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:05.988752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:05.989197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:05.989584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.2209 - val_loss: 0.2407 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2096 - val_loss: 0.2166 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1912 - val_loss: 0.2098 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1801 - val_loss: 0.2100 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1761 - val_loss: 0.1988 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1618 - val_loss: 0.1953 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1493 - val_loss: 0.1811 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1324 - val_loss: 0.1731 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1588 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1306 - val_loss: 0.1868 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1193 - val_loss: 0.1834 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1259 - val_loss: 0.1517 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1060 - val_loss: 0.1830 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1104 - val_loss: 0.1460 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1058 - val_loss: 0.1800 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1069 - val_loss: 0.1480 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0980 - val_loss: 0.1665 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1007 - val_loss: 0.1489 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0964 - val_loss: 0.1635 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.1459 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0944 - val_loss: 0.1535 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0951 - val_loss: 0.1493 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0938 - val_loss: 0.1495 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0930 - val_loss: 0.1492 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0929 - val_loss: 0.1479 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0924 - val_loss: 0.1463 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0926 - val_loss: 0.1467 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0922 - val_loss: 0.1460 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0916 - val_loss: 0.1462 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0918 - val_loss: 0.1470 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0920 - val_loss: 0.1472 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0918 - val_loss: 0.1474 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0919 - val_loss: 0.1473 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0919 - val_loss: 0.1472 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0919 - val_loss: 0.1472 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0919 - val_loss: 0.1473 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0911 - val_loss: 0.1472 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0901 - val_loss: 0.1471 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0919 - val_loss: 0.1470 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0920 - val_loss: 0.1470 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:27:08.440556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.440969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.441454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:08.497367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.497746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.498092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:08.577262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.577712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.578104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:08.637233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.637674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.638093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:08.820833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.821764: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.822731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:08.886057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:08.886568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:08.887000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 18ms/step - loss: 0.2578 - val_loss: 0.1852 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1969

2023-11-27 18:27:09.351473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:09.352086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:09.352511: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:09.412574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:09.413009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:09.413395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.2173 - val_loss: 0.1794 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2018 - val_loss: 0.1609 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1864 - val_loss: 0.1573 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1757 - val_loss: 0.1464 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1647 - val_loss: 0.1498 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1566 - val_loss: 0.1382 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1481 - val_loss: 0.1287 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1368 - val_loss: 0.1364 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1314 - val_loss: 0.1374 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1288 - val_loss: 0.1197 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1229 - val_loss: 0.1150 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1137 - val_loss: 0.1174 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1066 - val_loss: 0.1212 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1053 - val_loss: 0.1207 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1055 - val_loss: 0.1050 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1024 - val_loss: 0.1017 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0971 - val_loss: 0.1034 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0919 - val_loss: 0.1099 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.1139 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1048 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.1029 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0866 - val_loss: 0.1038 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.1025 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.1035 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.1047 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1025 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.1056 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.1014 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1030 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.1040 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.1041 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1032 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1032 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0829 - val_loss: 0.1033 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.1034 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.1032 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.1033 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1032 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1032 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0821 - val_loss: 0.1034 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.1034 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1034 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1034 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.1034 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.1034 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1034 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.1034 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1034 - lr: 6.7729e-08
Epoch 1/100

2023-11-27 18:27:13.345557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.346522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.347009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:13.404266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.404631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.404928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:13.487349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.487919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.488492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:13.551789: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.552358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.553041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:13.787266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.787725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.788173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:13.846549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:13.847040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:13.847459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.2195 - val_loss: 0.2051 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1556

2023-11-27 18:27:14.503951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:14.504736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:14.505132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:14.565876: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:14.566321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:14.566706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 6ms/step - loss: 0.1898 - val_loss: 0.1778 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1784 - val_loss: 0.1689 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1699 - val_loss: 0.1561 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1558 - val_loss: 0.1450 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1448 - val_loss: 0.1375 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1376 - val_loss: 0.1301 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1299 - val_loss: 0.1269 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1250 - val_loss: 0.1236 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1227 - val_loss: 0.1220 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1200 - val_loss: 0.1144 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1134 - val_loss: 0.1092 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1092 - val_loss: 0.1042 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.1001 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0988 - val_loss: 0.0981 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0962 - val_loss: 0.0956 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0932 - val_loss: 0.0936 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0923 - val_loss: 0.0911 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0906 - val_loss: 0.0880 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0872 - val_loss: 0.0861 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0850 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0834 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0831 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0834 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0821 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0813 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0811 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0753 - val_loss: 0.0811 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0811 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0806 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0812 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0815 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0809 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0806 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0805 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0806 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0734 - val_loss: 0.0807 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0807 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0808 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0807 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0733 - val_loss: 0.0807 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0807 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0807 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0731 - val_loss: 0.0807 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0724 - val_loss: 0.0807 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0730 - val_loss: 0.0807 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0807 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0735 - val_loss: 0.0807 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0807 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0807 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0735 - val_loss: 0.0807 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0807 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0807 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0807 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0807 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:27:21.909080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:21.909654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:21.910041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:21.962779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:21.963157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:21.963500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:22.045059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:22.045528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:22.046002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:22.105602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:22.106077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:22.106500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:22.338173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:22.338630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:22.339070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:22.397460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:22.397915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:22.398337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.2207 - val_loss: 0.1940 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1633

2023-11-27 18:27:23.105452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:23.106043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:23.106441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:23.167452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:23.167872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:23.168247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1854 - val_loss: 0.1848 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1693 - val_loss: 0.1717 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1519 - val_loss: 0.1533 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1395 - val_loss: 0.1368 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1300 - val_loss: 0.1326 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1230 - val_loss: 0.1229 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1150 - val_loss: 0.1197 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1101 - val_loss: 0.1158 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.1082 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0959 - val_loss: 0.1067 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0933 - val_loss: 0.1036 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0913 - val_loss: 0.1030 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0865 - val_loss: 0.0977 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0988 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0970 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0993 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0782 - val_loss: 0.1008 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0792 - val_loss: 0.0976 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.1061 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1138 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.1165 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0921 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.0877 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.0821 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0810 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0803 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0766 - val_loss: 0.0777 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0775 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0773 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0766 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0761 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0761 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0758 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0725 - val_loss: 0.0756 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0757 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0756 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0756 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0756 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0756 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0756 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0756 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0756 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0756 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0756 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0756 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0717 - val_loss: 0.0756 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0719 - val_loss: 0.0756 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0756 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0756 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0756 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0756 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0756 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0756 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0756 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0756 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0756 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0756 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0756 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0756 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0756 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0756 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0756 - lr: 5.0565e-11
Epoch 1/100

2023-11-27 18:27:33.540317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:33.540754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:33.541368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:33.596009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:33.596453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:33.596858: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:33.680002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:33.680512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:33.680968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:33.740263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:33.740734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:33.741290: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:33.988336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:33.988810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:33.989246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:34.049733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:34.050221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:34.050628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.2167 - val_loss: 0.1916 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1419

2023-11-27 18:27:34.781032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:34.781500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:34.782169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:34.843817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:34.844244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:34.844629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1738 - val_loss: 0.1671 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1512 - val_loss: 0.1522 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1338 - val_loss: 0.1402 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1241 - val_loss: 0.1311 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1170 - val_loss: 0.1279 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1097 - val_loss: 0.1201 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1048 - val_loss: 0.1152 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.1098 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0957 - val_loss: 0.1060 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0890 - val_loss: 0.1013 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0976 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0966 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.0963 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0921 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0849 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0688 - val_loss: 0.0830 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0805 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0648 - val_loss: 0.0781 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0774 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0768 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0758 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0752 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0748 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0743 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0741 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.0735 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0729 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0727 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0728 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0728 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0728 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0728 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0728 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0728 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0728 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0728 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0728 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0728 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0728 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0728 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0728 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0728 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0581 - val_loss: 0.0728 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0728 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0582 - val_loss: 0.0728 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0728 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0578 - val_loss: 0.0728 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0728 - lr: 1.6702e-08
Average Validation Loss: 0.09521943777799606
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:27:45.727800: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:45.728479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:45.729008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:45.787370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:45.787757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:45.788101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:45.869622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:45.870101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:45.870526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:45.931130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:45.931734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:45.932101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:46.169373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:46.170029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:46.170473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:46.236293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:46.236732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:46.237180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.3519 - val_loss: 0.2586 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1985

2023-11-27 18:27:46.800897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:46.801507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:46.802111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:46.863348: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:46.863787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:46.864167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.2183 - val_loss: 0.2475 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2170 - val_loss: 0.2638 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2251 - val_loss: 0.2638 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2209 - val_loss: 0.2512 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2137 - val_loss: 0.2346 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2017 - val_loss: 0.2222 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1951 - val_loss: 0.2160 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1901 - val_loss: 0.2155 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1838 - val_loss: 0.2175 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 13ms/step - loss: 0.1819 - val_loss: 0.2175 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1767 - val_loss: 0.2148 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1725 - val_loss: 0.2111 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1686 - val_loss: 0.2082 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1624 - val_loss: 0.2043 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1569 - val_loss: 0.2035 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1559 - val_loss: 0.2032 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1536 - val_loss: 0.1995 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1499 - val_loss: 0.1984 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1469 - val_loss: 0.1963 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1438 - val_loss: 0.1939 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1423 - val_loss: 0.1919 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1390 - val_loss: 0.1922 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1407 - val_loss: 0.1920 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1376 - val_loss: 0.1902 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1370 - val_loss: 0.1890 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1338 - val_loss: 0.1886 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1356 - val_loss: 0.1884 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1334 - val_loss: 0.1882 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1332 - val_loss: 0.1883 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1345 - val_loss: 0.1880 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1319 - val_loss: 0.1877 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 12ms/step - loss: 0.1313 - val_loss: 0.1876 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1331 - val_loss: 0.1874 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1322 - val_loss: 0.1873 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1318 - val_loss: 0.1872 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1320 - val_loss: 0.1873 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1321 - val_loss: 0.1872 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1332 - val_loss: 0.1872 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1313 - val_loss: 0.1872 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1324 - val_loss: 0.1872 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1303 - val_loss: 0.1872 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1308 - val_loss: 0.1872 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1321 - val_loss: 0.1872 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1320 - val_loss: 0.1872 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1315 - val_loss: 0.1872 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1310 - val_loss: 0.1871 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1341 - val_loss: 0.1871 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1327 - val_loss: 0.1871 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1871 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1318 - val_loss: 0.1871 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1326 - val_loss: 0.1871 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1331 - val_loss: 0.1871 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1326 - val_loss: 0.1871 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 13ms/step - loss: 0.1325 - val_loss: 0.1871 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1325 - val_loss: 0.1871 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1301 - val_loss: 0.1871 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1325 - val_loss: 0.1871 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1313 - val_loss: 0.1871 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1303 - val_loss: 0.1871 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1319 - val_loss: 0.1871 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1300 - val_loss: 0.1871 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1319 - val_loss: 0.1871 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1316 - val_loss: 0.1871 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1305 - val_loss: 0.1871 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1871 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1871 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1327 - val_loss: 0.1871 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1338 - val_loss: 0.1871 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1314 - val_loss: 0.1871 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1322 - val_loss: 0.1871 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1329 - val_loss: 0.1871 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1323 - val_loss: 0.1871 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1321 - val_loss: 0.1871 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1323 - val_loss: 0.1871 - lr: 2.2897e-14
Epoch 1/100

2023-11-27 18:27:50.703462: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:50.704176: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:50.704878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:50.764931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:50.765552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:50.766080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:50.849539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:50.850028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:50.850467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:50.912619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:50.913131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:50.913657: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:51.148528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:51.149072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:51.149497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:51.208026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:51.208480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:51.208896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.2484 - val_loss: 0.1934 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2514

2023-11-27 18:27:51.793996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:51.794471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:51.795124: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:51.855598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:51.856006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:51.856463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.2216 - val_loss: 0.1952 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 9ms/step - loss: 0.2080 - val_loss: 0.1806 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1944 - val_loss: 0.1585 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1821 - val_loss: 0.1798 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1766 - val_loss: 0.1660 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1653 - val_loss: 0.1755 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1559 - val_loss: 0.1679 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1506 - val_loss: 0.1666 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1468 - val_loss: 0.1540 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1393 - val_loss: 0.1522 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1323 - val_loss: 0.1552 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1293 - val_loss: 0.1460 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1265 - val_loss: 0.1455 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1229 - val_loss: 0.1445 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1184 - val_loss: 0.1394 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1174 - val_loss: 0.1355 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1139 - val_loss: 0.1305 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1129 - val_loss: 0.1292 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1093 - val_loss: 0.1303 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1097 - val_loss: 0.1267 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1069 - val_loss: 0.1265 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1074 - val_loss: 0.1261 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1043 - val_loss: 0.1248 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1056 - val_loss: 0.1252 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1045 - val_loss: 0.1221 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1032 - val_loss: 0.1242 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1046 - val_loss: 0.1234 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1021 - val_loss: 0.1238 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1222 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1035 - val_loss: 0.1221 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1029 - val_loss: 0.1231 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1234 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1229 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1025 - val_loss: 0.1226 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1025 - val_loss: 0.1224 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1017 - val_loss: 0.1223 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1019 - val_loss: 0.1222 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1025 - val_loss: 0.1221 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1026 - val_loss: 0.1223 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1026 - val_loss: 0.1223 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1019 - val_loss: 0.1224 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1021 - val_loss: 0.1224 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1018 - val_loss: 0.1225 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1021 - val_loss: 0.1225 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1019 - val_loss: 0.1225 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1025 - val_loss: 0.1225 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1225 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1027 - val_loss: 0.1225 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1022 - val_loss: 0.1225 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1019 - val_loss: 0.1225 - lr: 2.7536e-08
Epoch 1/100

2023-11-27 18:27:55.892301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:55.892803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:55.893347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:55.951240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:55.951623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:55.951976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:56.039334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:56.039757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:56.040188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:56.104868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:56.105584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:56.106084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:56.951561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:56.952303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:56.952798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:57.012781: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:57.013249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:57.013671: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 2s 27ms/step - loss: 0.2193 - val_loss: 0.2088 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2197

2023-11-27 18:27:57.652150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:57.652640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:57.653333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:27:57.713158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:27:57.713580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:27:57.713958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 9ms/step - loss: 0.2034 - val_loss: 0.1986 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1846 - val_loss: 0.1864 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1754 - val_loss: 0.1672 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1639 - val_loss: 0.1523 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1496 - val_loss: 0.1359 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1409 - val_loss: 0.1274 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1354 - val_loss: 0.1209 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1274 - val_loss: 0.1139 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1204 - val_loss: 0.1108 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1177 - val_loss: 0.1099 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1190 - val_loss: 0.1267 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1126 - val_loss: 0.1315 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1090 - val_loss: 0.1166 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1053 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0992 - val_loss: 0.1040 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0979 - val_loss: 0.1028 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0987 - val_loss: 0.1131 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0965 - val_loss: 0.1102 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0936 - val_loss: 0.0988 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0920 - val_loss: 0.0950 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0915 - val_loss: 0.1026 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0890 - val_loss: 0.0992 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0882 - val_loss: 0.0980 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0876 - val_loss: 0.0973 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0881 - val_loss: 0.0967 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0874 - val_loss: 0.0951 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0870 - val_loss: 0.0963 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0949 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0954 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0952 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0863 - val_loss: 0.0958 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0860 - val_loss: 0.0948 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0945 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0866 - val_loss: 0.0948 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0862 - val_loss: 0.0949 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0854 - val_loss: 0.0949 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0949 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0861 - val_loss: 0.0948 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0947 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0858 - val_loss: 0.0948 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0948 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0864 - val_loss: 0.0948 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0869 - val_loss: 0.0948 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0871 - val_loss: 0.0948 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0864 - val_loss: 0.0948 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0862 - val_loss: 0.0948 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0861 - val_loss: 0.0948 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0948 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0857 - val_loss: 0.0948 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0948 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0948 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 10ms/step - loss: 0.0869 - val_loss: 0.0948 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0863 - val_loss: 0.0948 - lr: 6.1442e-09
Epoch 1/100

2023-11-27 18:28:03.478627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.479086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.479466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:03.530992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.531382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.531732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:03.613099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.613633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.614075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:03.673285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.673739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.674168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:03.904668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.905140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.905581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:03.964174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:03.964641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:03.965076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 22ms/step - loss: 0.2318 - val_loss: 0.2145 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2371

2023-11-27 18:28:04.611734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:04.612239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:04.612889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:04.674087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:04.674518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:04.674910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 8ms/step - loss: 0.2034 - val_loss: 0.1990 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1844 - val_loss: 0.1895 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1716 - val_loss: 0.2052 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1708 - val_loss: 0.1847 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1609 - val_loss: 0.1529 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1392 - val_loss: 0.1649 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1358 - val_loss: 0.1664 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1354 - val_loss: 0.1718 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1366 - val_loss: 0.1345 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1208 - val_loss: 0.1296 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1131 - val_loss: 0.1366 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1119 - val_loss: 0.1260 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1059 - val_loss: 0.1237 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1035 - val_loss: 0.1166 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1054 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0964 - val_loss: 0.1006 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0920 - val_loss: 0.0956 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0896 - val_loss: 0.0889 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0909 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0887 - val_loss: 0.0875 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0895 - val_loss: 0.0776 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0851 - val_loss: 0.0770 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0811 - val_loss: 0.0760 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0816 - val_loss: 0.0755 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0811 - val_loss: 0.0752 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0813 - val_loss: 0.0749 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0807 - val_loss: 0.0748 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.0746 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0799 - val_loss: 0.0744 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.0743 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0743 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0795 - val_loss: 0.0742 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0796 - val_loss: 0.0742 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.0741 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0797 - val_loss: 0.0741 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0796 - val_loss: 0.0741 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0741 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0741 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.0741 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0790 - val_loss: 0.0740 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0792 - val_loss: 0.0740 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0799 - val_loss: 0.0740 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0799 - val_loss: 0.0740 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0797 - val_loss: 0.0740 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0785 - val_loss: 0.0740 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0787 - val_loss: 0.0740 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0794 - val_loss: 0.0740 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0791 - val_loss: 0.0740 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0740 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0798 - val_loss: 0.0740 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0798 - val_loss: 0.0740 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0740 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0740 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0795 - val_loss: 0.0740 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0799 - val_loss: 0.0740 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0789 - val_loss: 0.0740 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0790 - val_loss: 0.0740 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0789 - val_loss: 0.0740 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0795 - val_loss: 0.0740 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0800 - val_loss: 0.0740 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0788 - val_loss: 0.0740 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0792 - val_loss: 0.0740 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0796 - val_loss: 0.0740 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.0740 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0790 - val_loss: 0.0740 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0788 - val_loss: 0.0740 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0785 - val_loss: 0.0740 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0740 - lr: 4.6110e-14
Epoch 1/100

2023-11-27 18:28:14.080079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.080501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.081067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:14.133610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.134023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.134415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:14.216412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.216903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.217323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:14.276710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.277175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.277604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:14.510452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.510909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.511436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:14.568332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:14.568783: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:14.569215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 18ms/step - loss: 0.2320 - val_loss: 0.2039 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2108

2023-11-27 18:28:15.243461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:15.243956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:15.244633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:15.305923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:15.306363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:15.306748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.2000 - val_loss: 0.1882 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 6ms/step - loss: 0.1833 - val_loss: 0.1807 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1707 - val_loss: 0.1682 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1556 - val_loss: 0.1512 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1451 - val_loss: 0.1476 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1407 - val_loss: 0.1479 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1344 - val_loss: 0.1294 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1214 - val_loss: 0.1268 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1206 - val_loss: 0.1330 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1197 - val_loss: 0.1257 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1118 - val_loss: 0.1172 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1061 - val_loss: 0.1173 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1035 - val_loss: 0.1115 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0978 - val_loss: 0.1049 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0925 - val_loss: 0.0995 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0888 - val_loss: 0.0959 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0855 - val_loss: 0.0921 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0832 - val_loss: 0.0919 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0826 - val_loss: 0.0918 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0810 - val_loss: 0.0869 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0781 - val_loss: 0.0846 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0795 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0728 - val_loss: 0.0777 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.0766 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0716 - val_loss: 0.0754 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0706 - val_loss: 0.0747 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0708 - val_loss: 0.0741 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0699 - val_loss: 0.0738 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0701 - val_loss: 0.0733 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0700 - val_loss: 0.0730 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0727 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0694 - val_loss: 0.0725 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0725 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0696 - val_loss: 0.0725 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0693 - val_loss: 0.0723 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0693 - val_loss: 0.0723 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0690 - val_loss: 0.0723 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0686 - val_loss: 0.0723 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0723 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0698 - val_loss: 0.0722 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0693 - val_loss: 0.0722 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0688 - val_loss: 0.0722 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0687 - val_loss: 0.0722 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0687 - val_loss: 0.0722 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0691 - val_loss: 0.0722 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0722 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0685 - val_loss: 0.0722 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0722 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0687 - val_loss: 0.0722 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0689 - val_loss: 0.0722 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0688 - val_loss: 0.0722 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0691 - val_loss: 0.0722 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0689 - val_loss: 0.0722 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0689 - val_loss: 0.0722 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0696 - val_loss: 0.0722 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0686 - val_loss: 0.0722 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0695 - val_loss: 0.0722 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0688 - val_loss: 0.0722 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0691 - val_loss: 0.0722 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0700 - val_loss: 0.0722 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0687 - val_loss: 0.0722 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0696 - val_loss: 0.0722 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0688 - val_loss: 0.0722 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0690 - val_loss: 0.0722 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0687 - val_loss: 0.0722 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0689 - val_loss: 0.0722 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0692 - val_loss: 0.0722 - lr: 5.6464e-15
Average Validation Loss: 0.11000065356492997
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:28:27.465518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:27.466145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:27.466507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:27.525936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:27.526311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:27.526675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:27.613764: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:27.614490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:27.615085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:27.680699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:27.681224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:27.681782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:27.934958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:27.935435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:27.936005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:27.999868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:28.000327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:28.000748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 21ms/step - loss: 0.1099 - val_loss: 0.1861 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1590

2023-11-27 18:28:28.654155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:28.654956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:28.655400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:28.716577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:28.717032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:28.717412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.1391 - val_loss: 0.1261 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1010 - val_loss: 0.1476 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1186 - val_loss: 0.1191 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1534 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1011 - val_loss: 0.1274 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.1109 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.1065 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1057 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0655 - val_loss: 0.1068 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0950 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0546 - val_loss: 0.1008 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.1253 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0962 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0953 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0905 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0963 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.1089 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0947 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0910 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0935 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0924 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0948 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0418 - val_loss: 0.0931 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0930 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0915 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0937 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0414 - val_loss: 0.0943 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0915 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0928 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0935 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0940 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0937 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0930 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0931 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0934 - lr: 6.0967e-06
Epoch 1/100

2023-11-27 18:28:31.936481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:31.936862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:31.937338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:31.997002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:31.997410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:31.997748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:32.089082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:32.090013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:32.090965: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:32.161891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:32.162674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:32.163158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:32.356935: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:32.357419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:32.357859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:32.419518: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:32.420163: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:32.420644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1367 - val_loss: 0.1206 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0542

2023-11-27 18:28:32.980109: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:32.980863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:32.981317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:33.052533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:33.052918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:33.053276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1350 - val_loss: 0.0764 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1305 - val_loss: 0.0891 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1241 - val_loss: 0.0743 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1173 - val_loss: 0.0934 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1149 - val_loss: 0.0715 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1167 - val_loss: 0.0836 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1099 - val_loss: 0.0855 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1074 - val_loss: 0.0765 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1038 - val_loss: 0.0866 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1005 - val_loss: 0.0781 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0891 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0870 - val_loss: 0.0925 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0869 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0816 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0772 - val_loss: 0.0749 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0753 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0648 - val_loss: 0.0720 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0639 - val_loss: 0.0651 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0649 - val_loss: 0.0631 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0609 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0650 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0568 - val_loss: 0.0725 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0725 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0526 - val_loss: 0.0687 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0519 - val_loss: 0.0729 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0504 - val_loss: 0.0731 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0704 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0500 - val_loss: 0.0710 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0510 - val_loss: 0.0729 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0712 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0498 - val_loss: 0.0707 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0712 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0720 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0717 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0502 - val_loss: 0.0718 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0719 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0717 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0717 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0494 - val_loss: 0.0716 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:28:37.519467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:37.519923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:37.520418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:37.575021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:37.575415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:37.575740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:37.656243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:37.656695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:37.657120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:37.717499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:37.717985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:37.718403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:37.951041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:37.951503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:37.952040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:38.010025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:38.010481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:38.010888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1310 - val_loss: 0.1169 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.0971

2023-11-27 18:28:38.747678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:38.748300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:38.748841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:38.810076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:38.810547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:38.810973: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1176 - val_loss: 0.1069 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1134 - val_loss: 0.1008 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1073 - val_loss: 0.0965 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1061 - val_loss: 0.0950 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1022 - val_loss: 0.0911 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0999 - val_loss: 0.0882 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0974 - val_loss: 0.0878 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0953 - val_loss: 0.0857 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0913 - val_loss: 0.0850 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0902 - val_loss: 0.0810 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0808 - val_loss: 0.0748 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0789 - val_loss: 0.0699 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0745 - val_loss: 0.0661 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0689 - val_loss: 0.0600 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0580 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0566 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0561 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0522 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0534 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0525 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0519 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0520 - val_loss: 0.0502 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0491 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0511 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0514 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0540 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0481 - val_loss: 0.0541 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0534 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0464 - val_loss: 0.0537 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0543 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0548 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0542 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0548 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0548 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0548 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0549 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0548 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0548 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0547 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0546 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0546 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0546 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0546 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:28:47.253932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.254464: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.255063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:47.314375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.314752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.315141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:47.401270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.401757: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.402266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:47.469551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.470240: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.470717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:47.720155: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.720620: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.721125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:47.779532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:47.779987: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:47.780413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.1267 - val_loss: 0.1466 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1581

2023-11-27 18:28:48.584129: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:48.584606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:48.585289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:28:48.648730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:28:48.649205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:28:48.649597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1194 - val_loss: 0.1267 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1108 - val_loss: 0.1223 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1055 - val_loss: 0.1087 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0992 - val_loss: 0.0971 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0932 - val_loss: 0.0915 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0865 - val_loss: 0.0959 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0827 - val_loss: 0.0988 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0769 - val_loss: 0.1148 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.0839 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0913 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0680 - val_loss: 0.0819 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0654 - val_loss: 0.0760 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0758 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0724 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0739 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0706 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0537 - val_loss: 0.0726 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0533 - val_loss: 0.0718 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0524 - val_loss: 0.0731 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0532 - val_loss: 0.0757 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0737 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0735 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0504 - val_loss: 0.0716 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0706 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0661 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0635 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0607 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0595 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0569 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0461 - val_loss: 0.0554 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0544 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0539 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0534 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0530 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0529 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0526 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0526 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0525 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0524 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0524 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0523 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0523 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0523 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0523 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0523 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0523 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0523 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0523 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0523 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0523 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0523 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0523 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0523 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0523 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0523 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0523 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0523 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0523 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0443 - val_loss: 0.0523 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0523 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0523 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0523 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0523 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0523 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0523 - lr: 3.1068e-16
Epoch 82/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0447 - val_loss: 0.0523 - lr: 1.3960e-16
Epoch 83/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0523 - lr: 6.2726e-17
Epoch 1/100

2023-11-27 18:29:09.163193: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.163844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.164191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:09.221553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.221949: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.222305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:09.309388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.310047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.310579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:09.376292: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.376870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.377532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:09.638229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.638810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.639425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:09.702234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:09.702701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:09.703346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 2s 7ms/step - loss: 0.1281 - val_loss: 0.1082 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0543

2023-11-27 18:29:10.604820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:10.605385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:10.605851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:10.675181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:10.675724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:10.676262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1129 - val_loss: 0.1027 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1043 - val_loss: 0.0980 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1006 - val_loss: 0.0956 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0946 - val_loss: 0.0928 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0918 - val_loss: 0.0912 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0876 - val_loss: 0.0889 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0847 - val_loss: 0.0865 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0800 - val_loss: 0.0842 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0772 - val_loss: 0.0815 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0731 - val_loss: 0.0784 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0742 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0612 - val_loss: 0.0705 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0693 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0671 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0664 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0531 - val_loss: 0.0648 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0511 - val_loss: 0.0628 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0625 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0618 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0460 - val_loss: 0.0592 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0455 - val_loss: 0.0578 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0565 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0419 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0550 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0398 - val_loss: 0.0549 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0543 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0394 - val_loss: 0.0541 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0381 - val_loss: 0.0536 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0535 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0532 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0527 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0521 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0519 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0518 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0516 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0515 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0515 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0515 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0515 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0515 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0363 - val_loss: 0.0515 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0515 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0515 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0515 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0515 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0376 - val_loss: 0.0515 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0515 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0365 - val_loss: 0.0515 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0515 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0367 - val_loss: 0.0515 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0515 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0364 - val_loss: 0.0515 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0515 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0368 - val_loss: 0.0515 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0515 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0515 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0369 - val_loss: 0.0515 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0515 - lr: 3.7654e-13
Average Validation Loss: 0.061285991221666336
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:29:32.095823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:32.096426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:32.096758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:32.155448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:32.155840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:32.156189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:32.237431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:32.237906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:32.238328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:32.299302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:32.299791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:32.300214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:33.086975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:33.087426: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:33.087867: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:33.146686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:33.147160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:33.147591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 2s 36ms/step - loss: 0.1665 - val_loss: 0.1523 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0783

2023-11-27 18:29:33.732394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:33.733103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:33.733521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:33.793786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:33.794228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:33.794608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1285 - val_loss: 0.1647 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1313 - val_loss: 0.1463 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1181 - val_loss: 0.1340 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1106 - val_loss: 0.1318 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1051 - val_loss: 0.1343 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1024 - val_loss: 0.1340 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0974 - val_loss: 0.1297 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0853 - val_loss: 0.1357 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0796 - val_loss: 0.1229 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0690 - val_loss: 0.1328 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0646 - val_loss: 0.1321 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0629 - val_loss: 0.1171 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0592 - val_loss: 0.1305 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0575 - val_loss: 0.1233 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0546 - val_loss: 0.1191 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0520 - val_loss: 0.1250 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0534 - val_loss: 0.1209 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0523 - val_loss: 0.1145 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0515 - val_loss: 0.1250 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0519 - val_loss: 0.1143 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.1206 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0507 - val_loss: 0.1129 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0492 - val_loss: 0.1156 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0490 - val_loss: 0.1169 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0497 - val_loss: 0.1122 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0496 - val_loss: 0.1133 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.1136 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0487 - val_loss: 0.1147 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0493 - val_loss: 0.1141 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0484 - val_loss: 0.1135 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0505 - val_loss: 0.1129 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0491 - val_loss: 0.1133 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0489 - val_loss: 0.1132 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0500 - val_loss: 0.1130 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0495 - val_loss: 0.1130 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0500 - val_loss: 0.1130 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0498 - val_loss: 0.1130 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0485 - val_loss: 0.1131 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0488 - val_loss: 0.1131 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0489 - val_loss: 0.1131 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0487 - val_loss: 0.1131 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0496 - val_loss: 0.1131 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0491 - val_loss: 0.1131 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0492 - val_loss: 0.1131 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.1131 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:29:36.567675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:36.568154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:36.568976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:36.632543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:36.633014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:36.633503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:36.720060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:36.720655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:36.721080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:36.788291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:36.788986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:36.789474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:36.977801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:36.978410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:36.978928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:37.039595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:37.040080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:37.040568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1634 - val_loss: 0.0998 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0991

2023-11-27 18:29:37.510516: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:37.511341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:37.511836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:37.572975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:37.573400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:37.573793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1365 - val_loss: 0.1041 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1223 - val_loss: 0.0821 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1178 - val_loss: 0.0775 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1090 - val_loss: 0.0772 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1061 - val_loss: 0.0725 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1001 - val_loss: 0.0724 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.0820 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0906 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0676 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0867 - val_loss: 0.0706 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0733 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0748 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0783 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0660 - val_loss: 0.0756 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0721 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0715 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0692 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0615 - val_loss: 0.0702 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0602 - val_loss: 0.0701 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0688 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0701 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0722 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0724 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0719 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0723 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0709 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0701 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0546 - val_loss: 0.0715 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0528 - val_loss: 0.0693 - lr: 4.9787e-05
Epoch 1/100

2023-11-27 18:29:40.035203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.035627: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.036191: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:40.094153: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.094645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.095019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:40.178561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.179078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.179517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:40.243304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.244188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.244630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:40.491237: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.491866: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.492324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:40.550463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:40.550944: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:40.551350: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 16ms/step - loss: 0.1281 - val_loss: 0.1204 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0653

2023-11-27 18:29:41.220495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:41.221197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:41.221615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:41.287979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:41.288448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:41.289031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.1111 - val_loss: 0.1024 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1050 - val_loss: 0.0941 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0995 - val_loss: 0.0896 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.0878 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0877 - val_loss: 0.0815 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0800 - val_loss: 0.0688 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.0752 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0617 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0711 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0654 - val_loss: 0.0582 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0619 - val_loss: 0.0646 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0584 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0624 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0594 - val_loss: 0.0628 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0632 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0612 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0563 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0572 - val_loss: 0.0549 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0554 - val_loss: 0.0541 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0567 - val_loss: 0.0550 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0611 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0535 - val_loss: 0.0611 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0578 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0581 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0556 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0566 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0562 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0558 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0553 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0558 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0561 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0557 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0556 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0555 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0556 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0465 - val_loss: 0.0556 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0555 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0554 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0554 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:29:46.679743: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:46.680273: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:46.680696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:46.738655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:46.739028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:46.739380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:46.821797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:46.822204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:46.822624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:46.883495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:46.884081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:46.884501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:47.117146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:47.117870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:47.118340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:47.176556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:47.177014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:47.177437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 13ms/step - loss: 0.1383 - val_loss: 0.1153 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0790

2023-11-27 18:29:47.878902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:47.879446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:47.880158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:47.943893: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:47.944355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:47.944744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1125 - val_loss: 0.1238 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.1247 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1234 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0937 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0865 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0883 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0908 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0788 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0901 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0662 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0643 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0619 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0551 - val_loss: 0.0606 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0624 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0626 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0627 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0665 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0621 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0639 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0761 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0775 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0817 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0640 - val_loss: 0.0608 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0514 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0485 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0470 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0466 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0457 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0454 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0451 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0450 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0449 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0450 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0449 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0449 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0448 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0448 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0448 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0448 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0448 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0448 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0448 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0448 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0448 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0448 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0448 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0448 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0448 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0448 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0448 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0448 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0448 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0448 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0448 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0448 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0448 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0448 - lr: 5.0435e-10
Epoch 1/100

2023-11-27 18:29:57.819579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:57.820209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:57.820527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:57.877011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:57.877415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:57.877768: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:57.963306: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:57.963797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:57.964219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:58.027992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:58.028502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:58.028916: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:58.265645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:58.266095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:58.266531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:58.325090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:58.325550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:58.325991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 11ms/step - loss: 0.1233 - val_loss: 0.1112 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0609

2023-11-27 18:29:59.068440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:59.069016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:59.069596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:29:59.137023: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:29:59.137817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:29:59.138398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1040 - val_loss: 0.1035 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0973 - val_loss: 0.0992 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0937 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0906 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0870 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0691 - val_loss: 0.0833 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0842 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0821 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0772 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0789 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0765 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0755 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0744 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0752 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0783 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0720 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0728 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0665 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0624 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0639 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0643 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0630 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0629 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0629 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0622 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0618 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0612 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0603 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0596 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0589 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0586 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0584 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0584 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0583 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0583 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0582 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0582 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0582 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0582 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0582 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0582 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0582 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0582 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0582 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0582 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0582 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0582 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0582 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0582 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0582 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0582 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0582 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0582 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0582 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0582 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0582 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0582 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0582 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0396 - val_loss: 0.0582 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0582 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0582 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0582 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0582 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0582 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0582 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0582 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0582 - lr: 1.1370e-14
Average Validation Loss: 0.06736366376280785
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:30:14.472610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.473140: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.473736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:14.529691: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.530093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.530440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:14.611493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.611969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.612393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:14.671759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.672201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.672610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:14.905044: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.905517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.906035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:14.965753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:14.966431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:14.967004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.1537 - val_loss: 0.1464 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1022

2023-11-27 18:30:15.543084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:15.543550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:15.544148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:15.604933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:15.605383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:15.605767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.1195 - val_loss: 0.1524 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1220 - val_loss: 0.1555 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1206 - val_loss: 0.1493 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1153 - val_loss: 0.1394 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1108 - val_loss: 0.1322 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1083 - val_loss: 0.1295 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1027 - val_loss: 0.1284 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0955 - val_loss: 0.1264 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0870 - val_loss: 0.1256 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0792 - val_loss: 0.1232 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0689 - val_loss: 0.1269 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0675 - val_loss: 0.1214 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0630 - val_loss: 0.1211 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0600 - val_loss: 0.1256 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0589 - val_loss: 0.1223 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0577 - val_loss: 0.1240 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 13ms/step - loss: 0.0577 - val_loss: 0.1163 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0565 - val_loss: 0.1183 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0536 - val_loss: 0.1195 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0545 - val_loss: 0.1164 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0547 - val_loss: 0.1185 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0557 - val_loss: 0.1225 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0537 - val_loss: 0.1220 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0530 - val_loss: 0.1195 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0533 - val_loss: 0.1181 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0538 - val_loss: 0.1187 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0521 - val_loss: 0.1198 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0524 - val_loss: 0.1190 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0530 - val_loss: 0.1180 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0530 - val_loss: 0.1173 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0539 - val_loss: 0.1170 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0530 - val_loss: 0.1168 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0530 - val_loss: 0.1171 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0525 - val_loss: 0.1172 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0533 - val_loss: 0.1174 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0522 - val_loss: 0.1174 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0529 - val_loss: 0.1175 - lr: 4.5166e-06
Epoch 1/100

2023-11-27 18:30:17.634080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:17.635025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:17.635604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:17.695352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:17.695841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:17.696324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:17.782824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:17.783694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:17.784303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:17.848222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:17.848786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:17.849358: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:18.086128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:18.086580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:18.087112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:18.145079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:18.145544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:18.145984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 38ms/step - loss: 0.1721 - val_loss: 0.0991 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1156

2023-11-27 18:30:18.733728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:18.734359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:18.734820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:18.795398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:18.795848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:18.796232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.1375 - val_loss: 0.0925 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1288 - val_loss: 0.0938 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1189 - val_loss: 0.0921 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1116 - val_loss: 0.0768 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1028 - val_loss: 0.0907 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0959 - val_loss: 0.0972 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0948 - val_loss: 0.0794 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0829 - val_loss: 0.0870 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0784 - val_loss: 0.0969 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0775 - val_loss: 0.0846 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0736 - val_loss: 0.0829 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0708 - val_loss: 0.0813 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0693 - val_loss: 0.0901 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0681 - val_loss: 0.0898 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0674 - val_loss: 0.0824 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0656 - val_loss: 0.0876 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0649 - val_loss: 0.0811 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0638 - val_loss: 0.0820 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0629 - val_loss: 0.0800 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0629 - val_loss: 0.0803 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0618 - val_loss: 0.0782 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0618 - val_loss: 0.0808 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0603 - val_loss: 0.0782 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0612 - val_loss: 0.0798 - lr: 1.3534e-04
Epoch 1/100

2023-11-27 18:30:20.783826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:20.784778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:20.785233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:20.849922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:20.850388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:20.850754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:20.947210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:20.947852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:20.948508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:21.020133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:21.020670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:21.021356: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:21.257707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:21.258466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:21.258964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:21.327642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:21.328533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:21.329059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 29ms/step - loss: 0.1427 - val_loss: 0.1254 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1443

2023-11-27 18:30:21.968076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:21.968628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:21.969045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:22.033895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:22.034364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:22.034760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.1216 - val_loss: 0.1285 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1053 - val_loss: 0.1074 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1037 - val_loss: 0.0944 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0985 - val_loss: 0.0905 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0919 - val_loss: 0.0831 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0908 - val_loss: 0.0760 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0885 - val_loss: 0.0800 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0840 - val_loss: 0.0855 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0759 - val_loss: 0.0711 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0753 - val_loss: 0.0672 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0769 - val_loss: 0.0871 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0672 - val_loss: 0.0757 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0625 - val_loss: 0.0631 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0617 - val_loss: 0.0603 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0665 - val_loss: 0.0719 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0624 - val_loss: 0.0744 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0570 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0571 - val_loss: 0.0643 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 10ms/step - loss: 0.0571 - val_loss: 0.0695 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0533 - val_loss: 0.0615 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0531 - val_loss: 0.0620 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0522 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0520 - val_loss: 0.0595 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0609 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0512 - val_loss: 0.0591 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0590 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0503 - val_loss: 0.0582 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0501 - val_loss: 0.0588 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0499 - val_loss: 0.0594 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0588 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0589 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0588 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0589 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0589 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0589 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0589 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0589 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0505 - val_loss: 0.0589 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0499 - val_loss: 0.0588 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0497 - val_loss: 0.0588 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0506 - val_loss: 0.0588 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0588 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0588 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0588 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0497 - val_loss: 0.0588 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0499 - val_loss: 0.0588 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0588 - lr: 6.7729e-08
Epoch 1/100

2023-11-27 18:30:27.231637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:27.232145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:27.232608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:27.288408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:27.288788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:27.289144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:27.378308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:27.379081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:27.379798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:27.448882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:27.449510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:27.449963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:28.271503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:28.271969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:28.272421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:28.330634: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:28.331105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:28.331572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 2s 23ms/step - loss: 0.1637 - val_loss: 0.1394 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1680

2023-11-27 18:30:28.992333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:28.992816: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:28.993403: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:29.055862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:29.056325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:29.056725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 7ms/step - loss: 0.1330 - val_loss: 0.1102 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1114 - val_loss: 0.1122 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1033 - val_loss: 0.1249 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1009 - val_loss: 0.1219 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0977 - val_loss: 0.1147 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0941 - val_loss: 0.1039 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.1012 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0822 - val_loss: 0.0962 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0786 - val_loss: 0.0952 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.1051 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0787 - val_loss: 0.1052 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0840 - val_loss: 0.0826 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0734 - val_loss: 0.0767 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0670 - val_loss: 0.0743 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0646 - val_loss: 0.0772 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0648 - val_loss: 0.0809 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0666 - val_loss: 0.0739 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0663 - val_loss: 0.0653 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0609 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0573 - val_loss: 0.0542 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0537 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0543 - val_loss: 0.0521 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0537 - val_loss: 0.0473 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0469 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0459 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0513 - val_loss: 0.0456 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0448 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0447 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0443 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0503 - val_loss: 0.0442 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0514 - val_loss: 0.0441 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0493 - val_loss: 0.0441 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0441 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0508 - val_loss: 0.0441 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0495 - val_loss: 0.0439 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0499 - val_loss: 0.0439 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0438 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0500 - val_loss: 0.0438 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0505 - val_loss: 0.0438 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0438 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0438 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0497 - val_loss: 0.0438 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0510 - val_loss: 0.0438 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0510 - val_loss: 0.0438 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0438 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0438 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0506 - val_loss: 0.0438 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0438 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0438 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0498 - val_loss: 0.0438 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0506 - val_loss: 0.0438 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0495 - val_loss: 0.0438 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0500 - val_loss: 0.0438 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0497 - val_loss: 0.0438 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0510 - val_loss: 0.0438 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0498 - val_loss: 0.0438 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0438 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0503 - val_loss: 0.0438 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0438 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0497 - val_loss: 0.0438 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0501 - val_loss: 0.0438 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0438 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0438 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0500 - val_loss: 0.0438 - lr: 7.5826e-13
Epoch 1/100

2023-11-27 18:30:38.338552: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.339234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.339613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:38.394928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.395345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.395705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:38.479780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.480220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.480635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:38.540725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.541263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.541708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:38.774920: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.775731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.776410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:38.844484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:38.844928: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:38.845307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 19ms/step - loss: 0.1314 - val_loss: 0.1171 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1132

2023-11-27 18:30:39.539705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:39.540504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:39.540926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:39.603837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:39.604272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:39.604668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 8ms/step - loss: 0.1129 - val_loss: 0.1124 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1093 - val_loss: 0.1137 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1071 - val_loss: 0.1102 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1005 - val_loss: 0.1054 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0981 - val_loss: 0.1035 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0975 - val_loss: 0.1058 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0965 - val_loss: 0.1045 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0910 - val_loss: 0.0968 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 9ms/step - loss: 0.0890 - val_loss: 0.1001 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0902 - val_loss: 0.1016 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0954 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0780 - val_loss: 0.0890 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0907 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0752 - val_loss: 0.0942 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0895 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0696 - val_loss: 0.0830 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0645 - val_loss: 0.0843 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0641 - val_loss: 0.0840 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0642 - val_loss: 0.0804 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0612 - val_loss: 0.0772 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0582 - val_loss: 0.0704 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0531 - val_loss: 0.0690 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0521 - val_loss: 0.0655 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0510 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0625 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0502 - val_loss: 0.0616 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0495 - val_loss: 0.0608 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0494 - val_loss: 0.0602 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0599 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0598 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0594 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0484 - val_loss: 0.0593 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0593 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0592 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0480 - val_loss: 0.0592 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0592 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0591 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0591 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0591 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0591 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0476 - val_loss: 0.0591 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0478 - val_loss: 0.0591 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0591 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0591 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0591 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0591 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0591 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0475 - val_loss: 0.0591 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0591 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0591 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0483 - val_loss: 0.0591 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0591 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0591 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0480 - val_loss: 0.0591 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0591 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0483 - val_loss: 0.0591 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0483 - val_loss: 0.0591 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0591 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0591 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0472 - val_loss: 0.0591 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0591 - lr: 7.5826e-13
Average Validation Loss: 0.07081850916147232
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:30:51.093953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.094583: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.095019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:51.149948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.150347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.150689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:51.235839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.236339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.236766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:51.298121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.298686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.299118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:51.560229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.561066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.561502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:51.626624: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:51.627072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:51.627494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 21ms/step - loss: 0.1117 - val_loss: 0.1540 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1314

2023-11-27 18:30:52.289260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:52.289959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:52.290349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:52.358666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:52.359226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:52.359742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.1253 - val_loss: 0.1257 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1054 - val_loss: 0.1231 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1007 - val_loss: 0.1221 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.1176 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.1362 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1061 - val_loss: 0.1117 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.1212 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.1400 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.1221 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.1071 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0572 - val_loss: 0.1014 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.1035 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.1008 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0960 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0914 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0914 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0961 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0939 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0874 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0980 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0906 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0369 - val_loss: 0.0940 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0368 - val_loss: 0.0914 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0379 - val_loss: 0.0920 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0355 - val_loss: 0.0908 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0346 - val_loss: 0.0897 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0348 - val_loss: 0.0915 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0343 - val_loss: 0.0897 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0363 - val_loss: 0.0903 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0914 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0350 - val_loss: 0.0910 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0373 - val_loss: 0.0912 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0361 - val_loss: 0.0903 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0345 - val_loss: 0.0904 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0354 - val_loss: 0.0908 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0363 - val_loss: 0.0905 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0363 - val_loss: 0.0905 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0357 - val_loss: 0.0906 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0363 - val_loss: 0.0906 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:30:55.923540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:55.924082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:55.924454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:55.984241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:55.984607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:55.985019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:56.070343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:56.070805: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:56.071231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:56.143903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:56.144696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:56.145103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:56.351182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:56.352284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:56.352959: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:56.417162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:56.417864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:56.418484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1247 - val_loss: 0.1266 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0498

2023-11-27 18:30:56.972374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:56.972898: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:56.973271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:30:57.040860: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:30:57.041293: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:30:57.041672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 4ms/step - loss: 0.1269 - val_loss: 0.0689 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1194 - val_loss: 0.0777 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1138 - val_loss: 0.0619 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1111 - val_loss: 0.0677 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1093 - val_loss: 0.0624 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1049 - val_loss: 0.0650 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1008 - val_loss: 0.0684 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0960 - val_loss: 0.0774 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0957 - val_loss: 0.0655 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0886 - val_loss: 0.0887 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0813 - val_loss: 0.0897 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0773 - val_loss: 0.0848 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0757 - val_loss: 0.0809 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0870 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0665 - val_loss: 0.0833 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0722 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.0647 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0641 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0566 - val_loss: 0.0605 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0639 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0636 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0694 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0713 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0671 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0465 - val_loss: 0.0713 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0708 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0732 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0463 - val_loss: 0.0718 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0459 - val_loss: 0.0737 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0730 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0448 - val_loss: 0.0732 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0730 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0456 - val_loss: 0.0731 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0729 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0446 - val_loss: 0.0731 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0727 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0444 - val_loss: 0.0728 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0450 - val_loss: 0.0727 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0728 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:31:01.679485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:01.680389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:01.680861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:01.738658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:01.739021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:01.739371: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:01.822322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:01.822767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:01.823154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:01.912422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:01.913147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:01.913614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:02.164354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:02.164875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:02.165484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:02.223640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:02.224104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:02.224527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1193 - val_loss: 0.1011 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1024

2023-11-27 18:31:03.002279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:03.002861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:03.003274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:03.069230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:03.069696: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:03.070115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1090 - val_loss: 0.0932 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1048 - val_loss: 0.0918 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0996 - val_loss: 0.0838 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0958 - val_loss: 0.0811 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0944 - val_loss: 0.0802 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0910 - val_loss: 0.0797 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0856 - val_loss: 0.0751 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0906 - val_loss: 0.0755 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.0747 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0669 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0753 - val_loss: 0.0643 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0682 - val_loss: 0.0631 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0599 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0601 - val_loss: 0.0500 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0483 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0516 - val_loss: 0.0477 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0462 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0465 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0457 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0445 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0441 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0426 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0426 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0436 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0454 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0488 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0498 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0494 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0505 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0417 - val_loss: 0.0508 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0414 - val_loss: 0.0502 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0500 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0500 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0417 - val_loss: 0.0499 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0499 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0500 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0500 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0417 - val_loss: 0.0501 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0499 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0499 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0500 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0415 - val_loss: 0.0500 - lr: 7.4659e-07
Epoch 1/100

2023-11-27 18:31:11.467091: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:11.468104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:11.468702: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:11.532036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:11.532520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:11.532964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:11.620888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:11.621327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:11.621774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:11.689629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:11.690188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:11.690762: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:11.939638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:11.940088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:11.940629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:12.004760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:12.005269: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:12.005721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.1181 - val_loss: 0.1264 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1337

2023-11-27 18:31:12.815230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:12.815850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:12.816341: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:12.882618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:12.883177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:12.883611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1066 - val_loss: 0.1065 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1028 - val_loss: 0.0972 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0956 - val_loss: 0.0915 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0924 - val_loss: 0.0895 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0842 - val_loss: 0.0826 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0775 - val_loss: 0.0762 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0738 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0785 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.0943 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0649 - val_loss: 0.0822 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0691 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0556 - val_loss: 0.0721 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0629 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0583 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0569 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0572 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0587 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0567 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0563 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0550 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0546 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0533 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0535 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0519 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0495 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0484 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0456 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0452 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0430 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0426 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0408 - val_loss: 0.0423 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0413 - val_loss: 0.0420 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0420 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0417 - val_loss: 0.0418 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0417 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0417 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0417 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0410 - val_loss: 0.0417 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0416 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0416 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0416 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0416 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0416 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0416 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0396 - val_loss: 0.0416 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0416 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0416 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0416 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0416 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0416 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0416 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0416 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0416 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0416 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0416 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0416 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0416 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0416 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0416 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0416 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0402 - val_loss: 0.0416 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0416 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0403 - val_loss: 0.0416 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0416 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0401 - val_loss: 0.0416 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0409 - val_loss: 0.0416 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0416 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0416 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0399 - val_loss: 0.0416 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0404 - val_loss: 0.0416 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0408 - val_loss: 0.0416 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0402 - val_loss: 0.0416 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0406 - val_loss: 0.0416 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0416 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0405 - val_loss: 0.0416 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0403 - val_loss: 0.0416 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0398 - val_loss: 0.0416 - lr: 2.8039e-15
Epoch 1/100

2023-11-27 18:31:32.351118: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.351678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.352038: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:32.407631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.408035: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.408392: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:32.493795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.494375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.494908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:32.559359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.560201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.560684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:32.803018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.803679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.804167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:32.864068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:32.864533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:32.864922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 7ms/step - loss: 0.1173 - val_loss: 0.1034 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0513

2023-11-27 18:31:33.715572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:33.716344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:33.716796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:33.778232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:33.778676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:33.779059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1061 - val_loss: 0.1002 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1010 - val_loss: 0.0958 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0936 - val_loss: 0.0920 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0897 - val_loss: 0.0901 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0846 - val_loss: 0.0863 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0806 - val_loss: 0.0853 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0778 - val_loss: 0.0829 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0743 - val_loss: 0.0792 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.0758 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0743 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0718 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0689 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0669 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0526 - val_loss: 0.0645 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0635 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0630 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0610 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0587 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0580 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0566 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0411 - val_loss: 0.0551 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0545 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0390 - val_loss: 0.0538 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0528 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0375 - val_loss: 0.0529 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0527 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0364 - val_loss: 0.0530 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0525 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0366 - val_loss: 0.0519 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0358 - val_loss: 0.0511 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0361 - val_loss: 0.0511 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0361 - val_loss: 0.0508 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0358 - val_loss: 0.0506 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0348 - val_loss: 0.0506 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0506 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0350 - val_loss: 0.0506 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0506 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0350 - val_loss: 0.0505 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0354 - val_loss: 0.0505 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0344 - val_loss: 0.0505 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0348 - val_loss: 0.0505 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0346 - val_loss: 0.0505 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0347 - val_loss: 0.0505 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0350 - val_loss: 0.0505 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0505 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0348 - val_loss: 0.0505 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0354 - val_loss: 0.0505 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0505 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0353 - val_loss: 0.0505 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0353 - val_loss: 0.0505 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0505 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0354 - val_loss: 0.0505 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0351 - val_loss: 0.0505 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0351 - val_loss: 0.0505 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0505 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0505 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0505 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0348 - val_loss: 0.0505 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0351 - val_loss: 0.0505 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0347 - val_loss: 0.0505 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0353 - val_loss: 0.0505 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0350 - val_loss: 0.0505 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0505 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0356 - val_loss: 0.0505 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0344 - val_loss: 0.0505 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0355 - val_loss: 0.0505 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0347 - val_loss: 0.0505 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0505 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0351 - val_loss: 0.0505 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0354 - val_loss: 0.0505 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0352 - val_loss: 0.0505 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0349 - val_loss: 0.0505 - lr: 6.9144e-16
Epoch 81/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0357 - val_loss: 0.0505 - lr: 3.1068e-16
Epoch 82/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0351 - val_loss: 0.0505 - lr: 1.3960e-16
Epoch 83/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0353 - val_loss: 0.0505 - lr: 6.2726e-17
Average Validation Loss: 0.05651775673031807
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:31:58.770365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:58.770993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:58.771393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:58.826328: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:58.826737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:58.827084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:58.909170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:58.909649: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:58.910055: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:58.969453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:58.969901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:58.970314: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:59.217080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:59.217532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:59.218085: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:59.277774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:59.278226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:59.278642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1108 - val_loss: 0.1313 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0646

2023-11-27 18:31:59.887923: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:59.888352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:59.888739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:31:59.949936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:31:59.950367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:31:59.950746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.1027 - val_loss: 0.1326 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1051 - val_loss: 0.1189 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0952 - val_loss: 0.1154 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0908 - val_loss: 0.1165 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0870 - val_loss: 0.1146 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0819 - val_loss: 0.1111 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.1039 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0647 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0574 - val_loss: 0.0906 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0522 - val_loss: 0.0983 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.1147 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0476 - val_loss: 0.1077 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0436 - val_loss: 0.0934 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.1028 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0418 - val_loss: 0.1176 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0470 - val_loss: 0.0922 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0407 - val_loss: 0.1093 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0420 - val_loss: 0.1014 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0389 - val_loss: 0.1012 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0398 - val_loss: 0.1007 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0392 - val_loss: 0.1053 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0388 - val_loss: 0.0993 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0394 - val_loss: 0.1030 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0384 - val_loss: 0.1016 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0395 - val_loss: 0.1004 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0378 - val_loss: 0.1018 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0381 - val_loss: 0.1011 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0391 - val_loss: 0.1013 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0374 - val_loss: 0.1012 - lr: 4.9787e-05
Epoch 1/100

2023-11-27 18:32:01.805020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:01.805395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:01.805748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:01.859780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:01.860160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:01.860514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:01.941618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:01.942305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:01.942809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:02.572549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:02.573441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:02.573907: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:02.763847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:02.764372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:02.764836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:02.828411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:02.829745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:02.830372: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 2s 19ms/step - loss: 0.1343 - val_loss: 0.0821 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1011

2023-11-27 18:32:03.326025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:03.326709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:03.327172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:03.387909: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:03.388363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:03.388776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1194 - val_loss: 0.0849 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1086 - val_loss: 0.0694 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1052 - val_loss: 0.0694 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1020 - val_loss: 0.0624 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0966 - val_loss: 0.0601 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0898 - val_loss: 0.0680 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.0564 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0830 - val_loss: 0.0559 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0574 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0539 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0557 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0583 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0549 - val_loss: 0.0605 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0498 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0478 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0576 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0685 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0704 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0617 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0561 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0595 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0600 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0622 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0617 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0619 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.0606 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0630 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0609 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0444 - val_loss: 0.0621 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.0618 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0444 - val_loss: 0.0621 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0616 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0619 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0623 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0620 - lr: 8.2297e-06
Epoch 1/100

2023-11-27 18:32:06.321849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.322283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.322782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:06.381788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.382150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.382505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:06.466039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.466492: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.466843: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:06.527321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.527896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.528397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:06.762542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.763004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.763440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:06.823524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:06.823963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:06.824388: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.1220 - val_loss: 0.1181 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0548

2023-11-27 18:32:07.515342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:07.516093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:07.516544: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:07.578249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:07.578715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:07.579098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.1052 - val_loss: 0.1018 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0979 - val_loss: 0.0940 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0875 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0925 - val_loss: 0.0836 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0902 - val_loss: 0.0799 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0878 - val_loss: 0.0771 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.0798 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0777 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0741 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0665 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0649 - val_loss: 0.0642 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0630 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0665 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0691 - val_loss: 0.0629 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0690 - val_loss: 0.0582 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0534 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0531 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0520 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0519 - val_loss: 0.0525 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0494 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0534 - val_loss: 0.0513 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0520 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0499 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0500 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0498 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0485 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0499 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0488 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0485 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0488 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0493 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0441 - val_loss: 0.0487 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0486 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0486 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0488 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0487 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0488 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0487 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0440 - val_loss: 0.0487 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0487 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0487 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0486 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0487 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0487 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0487 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0487 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0487 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0487 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0487 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:32:14.289361: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.289861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.290249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:14.347170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.347555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.347934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:14.428746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.429305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.429820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:14.490043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.490531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.491010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:14.734918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.735614: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.736033: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:14.794506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:14.794989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:14.795412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1324 - val_loss: 0.0963 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0642

2023-11-27 18:32:15.507198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:15.507685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:15.508232: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:15.568576: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:15.569024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:15.569441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.0953 - val_loss: 0.0985 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0899 - val_loss: 0.0819 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.0823 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0722 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0685 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0652 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0628 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0600 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0577 - val_loss: 0.0588 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0570 - val_loss: 0.0558 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0545 - val_loss: 0.0538 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0527 - val_loss: 0.0504 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0497 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0505 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0532 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0460 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0462 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0478 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0447 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0488 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0519 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.0523 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0477 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0407 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0399 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0396 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0396 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0397 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0396 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.0394 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0393 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0415 - val_loss: 0.0393 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0392 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0392 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0392 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0392 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0392 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0391 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0391 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0392 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0391 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0391 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0414 - val_loss: 0.0391 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0391 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0391 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0391 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0391 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0391 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0391 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0391 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0391 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0391 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0391 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0391 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0391 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0391 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0391 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.0391 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0391 - lr: 1.6788e-10
Epoch 1/100

2023-11-27 18:32:25.680870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:25.681336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:25.681815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:25.735501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:25.735853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:25.736207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:25.822332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:25.822770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:25.823300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:25.886045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:25.886746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:25.887579: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:26.133215: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:26.134136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:26.134593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:26.204021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:26.204494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:26.204901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 11ms/step - loss: 0.1205 - val_loss: 0.1053 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0583

2023-11-27 18:32:26.970686: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:26.971219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:26.971863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:27.036362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:27.036854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:27.037262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.0998 - val_loss: 0.1012 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0921 - val_loss: 0.0970 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.0933 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0888 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0851 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0787 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0715 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0659 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0678 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0623 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0650 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0629 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0595 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0644 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0577 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0596 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0441 - val_loss: 0.0609 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0455 - val_loss: 0.0617 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.0577 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0538 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0507 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0508 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0506 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0380 - val_loss: 0.0499 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0493 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0490 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0376 - val_loss: 0.0486 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0382 - val_loss: 0.0483 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0375 - val_loss: 0.0481 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0375 - val_loss: 0.0483 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0378 - val_loss: 0.0486 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0376 - val_loss: 0.0487 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0373 - val_loss: 0.0488 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0376 - val_loss: 0.0487 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0371 - val_loss: 0.0488 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0374 - val_loss: 0.0488 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0376 - val_loss: 0.0488 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0488 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0370 - val_loss: 0.0488 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0489 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0370 - val_loss: 0.0488 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0369 - val_loss: 0.0489 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0370 - val_loss: 0.0489 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0373 - val_loss: 0.0489 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0372 - val_loss: 0.0488 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0369 - val_loss: 0.0488 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0375 - val_loss: 0.0488 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0375 - val_loss: 0.0489 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0369 - val_loss: 0.0489 - lr: 4.5400e-08
Average Validation Loss: 0.05482776612043381
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:32:37.218846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.219531: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.219946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:37.281025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.281438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.281796: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:37.371803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.372313: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.372780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:37.437510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.438132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.438586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:37.676195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.676931: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.677295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:37.735629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:37.736092: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:37.736501: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.2271 - val_loss: 0.1388 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0808

2023-11-27 18:32:38.310470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:38.311138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:38.311837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:38.373589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:38.374010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:38.374398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 10ms/step - loss: 0.0982 - val_loss: 0.1387 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1065 - val_loss: 0.1691 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1233 - val_loss: 0.1677 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1211 - val_loss: 0.1508 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1101 - val_loss: 0.1344 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1026 - val_loss: 0.1250 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0986 - val_loss: 0.1217 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0944 - val_loss: 0.1223 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0912 - val_loss: 0.1239 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0915 - val_loss: 0.1250 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0894 - val_loss: 0.1231 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0876 - val_loss: 0.1174 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0810 - val_loss: 0.1138 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0768 - val_loss: 0.1129 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0741 - val_loss: 0.1138 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0693 - val_loss: 0.1098 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0623 - val_loss: 0.1054 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0576 - val_loss: 0.1073 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0551 - val_loss: 0.1118 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0549 - val_loss: 0.1087 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0518 - val_loss: 0.1046 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0518 - val_loss: 0.1037 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0520 - val_loss: 0.1024 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0509 - val_loss: 0.1039 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0505 - val_loss: 0.1065 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0487 - val_loss: 0.1071 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0486 - val_loss: 0.1062 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0483 - val_loss: 0.1054 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0470 - val_loss: 0.1056 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0476 - val_loss: 0.1055 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0480 - val_loss: 0.1051 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0502 - val_loss: 0.1048 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0473 - val_loss: 0.1047 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0485 - val_loss: 0.1048 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0483 - val_loss: 0.1049 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0473 - val_loss: 0.1049 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0487 - val_loss: 0.1049 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 9ms/step - loss: 0.0481 - val_loss: 0.1049 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0489 - val_loss: 0.1049 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0499 - val_loss: 0.1049 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0473 - val_loss: 0.1050 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0483 - val_loss: 0.1050 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0481 - val_loss: 0.1050 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:32:40.563955: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:40.564428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:40.564854: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:40.619274: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:40.619672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:40.620004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:40.700308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:40.700793: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:40.701211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:40.760500: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:40.760993: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:40.761438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:40.998700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:40.999173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:40.999598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:41.057083: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:41.057537: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:41.057933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 38ms/step - loss: 0.1483 - val_loss: 0.0816 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1149

2023-11-27 18:32:41.668282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:41.669104: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:41.669639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:41.730599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:41.731043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:41.731429: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.1192 - val_loss: 0.0808 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1081 - val_loss: 0.0721 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1012 - val_loss: 0.0663 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0947 - val_loss: 0.0754 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0866 - val_loss: 0.0803 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0834 - val_loss: 0.0844 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0770 - val_loss: 0.0763 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0747 - val_loss: 0.0784 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0682 - val_loss: 0.0820 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0668 - val_loss: 0.0768 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0640 - val_loss: 0.0842 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0647 - val_loss: 0.0690 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0601 - val_loss: 0.0841 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0601 - val_loss: 0.0700 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0585 - val_loss: 0.0781 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0571 - val_loss: 0.0725 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0557 - val_loss: 0.0739 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0558 - val_loss: 0.0756 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0548 - val_loss: 0.0727 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0548 - val_loss: 0.0725 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0530 - val_loss: 0.0744 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0536 - val_loss: 0.0690 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0521 - val_loss: 0.0716 - lr: 1.6530e-04
Epoch 1/100

2023-11-27 18:32:43.638144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:43.638848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:43.639289: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:43.697208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:43.697603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:43.698047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:43.781617: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:43.782133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:43.782555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:43.846438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:43.846991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:43.847375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:44.088174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:44.089374: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:44.090120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:44.158415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:44.158929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:44.159376: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 26ms/step - loss: 0.1409 - val_loss: 0.1128 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1359

2023-11-27 18:32:44.776247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:44.776739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:44.777359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:44.837505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:44.837947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:44.838326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.1116 - val_loss: 0.1189 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0995 - val_loss: 0.1046 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0959 - val_loss: 0.0962 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0898 - val_loss: 0.0852 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0868 - val_loss: 0.0780 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0804 - val_loss: 0.0703 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0763 - val_loss: 0.0656 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0696 - val_loss: 0.0645 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0643 - val_loss: 0.0635 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0656 - val_loss: 0.0686 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0757 - val_loss: 0.0589 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0642 - val_loss: 0.0624 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0580 - val_loss: 0.0527 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0501 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0526 - val_loss: 0.0486 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0520 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0550 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0498 - val_loss: 0.0547 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0536 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0481 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0465 - val_loss: 0.0480 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0455 - val_loss: 0.0485 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0482 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0451 - val_loss: 0.0487 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0441 - val_loss: 0.0481 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0444 - val_loss: 0.0478 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0441 - val_loss: 0.0479 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0442 - val_loss: 0.0485 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0438 - val_loss: 0.0480 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0441 - val_loss: 0.0480 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0447 - val_loss: 0.0477 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0442 - val_loss: 0.0478 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0444 - val_loss: 0.0477 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0437 - val_loss: 0.0477 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0440 - val_loss: 0.0477 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0444 - val_loss: 0.0477 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0437 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0431 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0448 - val_loss: 0.0476 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0440 - val_loss: 0.0476 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0440 - val_loss: 0.0476 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0439 - val_loss: 0.0476 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0445 - val_loss: 0.0476 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0437 - val_loss: 0.0476 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0447 - val_loss: 0.0476 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0443 - val_loss: 0.0476 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:32:50.125910: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.126333: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.126939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:50.179879: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.180282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.180706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:50.262255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.262729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.263151: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:50.322801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.323260: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.323711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:50.557882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.558345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.558803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:50.618105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:50.618553: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:50.618995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 23ms/step - loss: 0.1275 - val_loss: 0.1105 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1299

2023-11-27 18:32:51.276869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:51.277625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:51.278032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:51.340389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:51.340878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:51.341321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1025 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0940 - val_loss: 0.0973 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0871 - val_loss: 0.1088 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0879 - val_loss: 0.1312 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0928 - val_loss: 0.0907 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0812 - val_loss: 0.0856 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0750 - val_loss: 0.1078 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0768 - val_loss: 0.1123 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0820 - val_loss: 0.0891 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0750 - val_loss: 0.0692 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0649 - val_loss: 0.0755 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0639 - val_loss: 0.0720 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0625 - val_loss: 0.0704 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0602 - val_loss: 0.0697 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0592 - val_loss: 0.0674 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0601 - val_loss: 0.0568 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0559 - val_loss: 0.0546 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0536 - val_loss: 0.0574 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0545 - val_loss: 0.0496 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0511 - val_loss: 0.0485 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0505 - val_loss: 0.0463 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0488 - val_loss: 0.0449 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0435 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0482 - val_loss: 0.0435 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0429 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0473 - val_loss: 0.0423 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0468 - val_loss: 0.0419 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0468 - val_loss: 0.0424 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0470 - val_loss: 0.0420 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0415 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0418 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0419 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0455 - val_loss: 0.0415 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0467 - val_loss: 0.0415 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0469 - val_loss: 0.0415 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0415 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0465 - val_loss: 0.0414 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0414 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0414 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0452 - val_loss: 0.0414 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0466 - val_loss: 0.0414 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0414 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0456 - val_loss: 0.0414 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0414 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0414 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0414 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0414 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0414 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0414 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0457 - val_loss: 0.0414 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0414 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0414 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0414 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0414 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0452 - val_loss: 0.0414 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0414 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0454 - val_loss: 0.0414 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0464 - val_loss: 0.0414 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0414 - lr: 3.0590e-10
Epoch 1/100

2023-11-27 18:32:59.721966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:59.722422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:59.722980: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:59.773869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:59.774241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:59.774588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:59.866787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:59.867235: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:59.867629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:32:59.929981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:32:59.930600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:32:59.931029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:00.164764: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:00.165283: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:00.165695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:00.224476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:00.224956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:00.225317: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 18ms/step - loss: 0.1331 - val_loss: 0.1063 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1158

2023-11-27 18:33:00.887299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:00.887765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:00.888439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:00.949437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:00.949882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:00.950263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 8ms/step - loss: 0.1082 - val_loss: 0.1065 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1022 - val_loss: 0.1056 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0962 - val_loss: 0.1011 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0922 - val_loss: 0.0989 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0904 - val_loss: 0.0999 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0888 - val_loss: 0.0983 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0958 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0823 - val_loss: 0.0940 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.0934 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.0928 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0740 - val_loss: 0.0932 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0737 - val_loss: 0.0905 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0686 - val_loss: 0.0877 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0654 - val_loss: 0.0877 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0645 - val_loss: 0.0857 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0630 - val_loss: 0.0850 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0618 - val_loss: 0.0833 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0580 - val_loss: 0.0804 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0560 - val_loss: 0.0781 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0549 - val_loss: 0.0758 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0738 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0505 - val_loss: 0.0727 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0491 - val_loss: 0.0708 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0699 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0689 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0473 - val_loss: 0.0687 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0474 - val_loss: 0.0679 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0461 - val_loss: 0.0676 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0674 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0468 - val_loss: 0.0671 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0670 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0669 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0667 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0666 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0469 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0666 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0666 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0665 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0462 - val_loss: 0.0665 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0466 - val_loss: 0.0665 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0665 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0454 - val_loss: 0.0665 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0460 - val_loss: 0.0665 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0665 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0453 - val_loss: 0.0665 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0665 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0665 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0665 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0460 - val_loss: 0.0665 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0465 - val_loss: 0.0665 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0665 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0665 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0463 - val_loss: 0.0665 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0453 - val_loss: 0.0665 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0469 - val_loss: 0.0665 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0459 - val_loss: 0.0665 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0665 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0462 - val_loss: 0.0665 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0457 - val_loss: 0.0665 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0457 - val_loss: 0.0665 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0459 - val_loss: 0.0665 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0461 - val_loss: 0.0665 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0464 - val_loss: 0.0665 - lr: 5.6464e-15
Epoch 78/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0466 - val_loss: 0.0665 - lr: 2.8039e-15
Epoch 79/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0458 - val_loss: 0.0665 - lr: 1.3924e-15
Average Validation Loss: 0.06482770889997483
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:33:13.662782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:13.663425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:13.663745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:13.718526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:13.718997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:13.719308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:13.802168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:13.802619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:13.803113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:13.862276: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:13.862745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:13.863161: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:14.095230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:14.095694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:14.096231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:14.153258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:14.153707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:14.154107: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 19ms/step - loss: 0.2170 - val_loss: 0.2766 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2740

2023-11-27 18:33:14.783223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:14.783817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:14.784214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:14.845304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:14.845822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:14.846174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.2371 - val_loss: 0.2260 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.2047 - val_loss: 0.2141 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1962 - val_loss: 0.2032 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1804 - val_loss: 0.1973 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1734 - val_loss: 0.1926 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1651 - val_loss: 0.1819 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1553 - val_loss: 0.1710 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 6ms/step - loss: 0.1350 - val_loss: 0.1674 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 6ms/step - loss: 0.1173 - val_loss: 0.1781 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1135 - val_loss: 0.1738 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.1841 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1236 - val_loss: 0.1432 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1005 - val_loss: 0.1473 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0954 - val_loss: 0.1469 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1359 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0908 - val_loss: 0.1393 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0903 - val_loss: 0.1336 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.1429 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.1312 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 6ms/step - loss: 0.0846 - val_loss: 0.1395 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.1283 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.1374 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0820 - val_loss: 0.1338 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.1283 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.1284 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.1325 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1303 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.1321 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1318 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.1315 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.1310 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.1300 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.1278 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.1283 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0785 - val_loss: 0.1289 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.1292 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0796 - val_loss: 0.1295 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1297 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.1299 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1297 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1296 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0812 - val_loss: 0.1296 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.1296 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 6ms/step - loss: 0.0789 - val_loss: 0.1296 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.1296 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.1296 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.1296 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0789 - val_loss: 0.1296 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.1296 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.1296 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0786 - val_loss: 0.1296 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0797 - val_loss: 0.1296 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0795 - val_loss: 0.1296 - lr: 6.1442e-09
Epoch 1/100

2023-11-27 18:33:19.825439: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:19.826054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:19.826409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:19.884082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:19.884467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:19.884824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:19.965503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:19.965985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:19.966410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:20.028728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:20.029334: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:20.029786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:20.223937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:20.224375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:20.225061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:20.285297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:20.285939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:20.286363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.2361 - val_loss: 0.2292 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1651

2023-11-27 18:33:20.794048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:20.794532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:20.795206: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:20.858977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:20.859517: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:20.860065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.2219 - val_loss: 0.1548 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1994 - val_loss: 0.1498 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 4ms/step - loss: 0.1830 - val_loss: 0.1341 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1729 - val_loss: 0.1327 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1620 - val_loss: 0.1135 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1542 - val_loss: 0.1148 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1460 - val_loss: 0.1153 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1427 - val_loss: 0.1088 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1412 - val_loss: 0.1007 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1317 - val_loss: 0.1031 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1241 - val_loss: 0.1013 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1184 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1135 - val_loss: 0.1007 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1083 - val_loss: 0.0965 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1030 - val_loss: 0.0956 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0986 - val_loss: 0.0893 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0954 - val_loss: 0.0870 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0887 - val_loss: 0.0841 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0867 - val_loss: 0.0817 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0824 - val_loss: 0.0812 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0812 - val_loss: 0.0796 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0791 - val_loss: 0.0803 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0762 - val_loss: 0.0792 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0759 - val_loss: 0.0800 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0731 - val_loss: 0.0805 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0733 - val_loss: 0.0814 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0811 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0816 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0710 - val_loss: 0.0827 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0817 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0709 - val_loss: 0.0815 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0816 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0702 - val_loss: 0.0821 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0822 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0824 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0824 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0824 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0689 - val_loss: 0.0824 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0824 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0824 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0693 - val_loss: 0.0824 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0696 - val_loss: 0.0824 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:33:25.986581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:25.987032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:25.987639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:26.042890: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:26.043281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:26.043640: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:26.125084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:26.125592: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:26.126053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:26.186243: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:26.186779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:26.187280: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:26.420323: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:26.420859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:26.421291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:26.478608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:26.479054: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:26.479467: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.2306 - val_loss: 0.1990 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.2256

2023-11-27 18:33:27.216010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:27.216471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:27.217040: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:27.277256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:27.277710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:27.278095: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1960 - val_loss: 0.1725 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1739 - val_loss: 0.1559 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1574 - val_loss: 0.1443 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1467 - val_loss: 0.1335 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1411 - val_loss: 0.1312 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1341 - val_loss: 0.1225 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1285 - val_loss: 0.1216 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1253 - val_loss: 0.1135 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1189 - val_loss: 0.1148 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1158 - val_loss: 0.1085 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1075 - val_loss: 0.1041 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1033 - val_loss: 0.0975 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0975 - val_loss: 0.0918 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0935 - val_loss: 0.0924 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0891 - val_loss: 0.0785 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0830 - val_loss: 0.0782 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0793 - val_loss: 0.0750 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0746 - val_loss: 0.0719 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0714 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0697 - val_loss: 0.0683 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0679 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0669 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0660 - val_loss: 0.0658 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0664 - val_loss: 0.0660 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0655 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0681 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0656 - val_loss: 0.0704 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0718 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0708 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0635 - val_loss: 0.0717 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0719 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0723 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0713 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0630 - val_loss: 0.0714 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0629 - val_loss: 0.0716 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0718 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0713 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0711 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0712 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - val_loss: 0.0713 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0713 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0619 - val_loss: 0.0713 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0614 - val_loss: 0.0713 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0616 - val_loss: 0.0713 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0623 - val_loss: 0.0713 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:33:36.603410: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:36.604088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:36.604472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:36.664820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:36.665174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:36.665494: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:36.755247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:36.755900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:36.756418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:36.826869: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:36.827601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:36.828423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:37.084473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:37.085226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:37.085782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:37.149063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:37.149542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:37.149964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.2323 - val_loss: 0.2203 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2284

2023-11-27 18:33:37.949851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:37.950369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:37.950918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:38.015294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:38.015754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:38.016146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1902 - val_loss: 0.1843 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1672 - val_loss: 0.1641 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1539 - val_loss: 0.1412 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1390 - val_loss: 0.1322 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1329 - val_loss: 0.1285 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1235 - val_loss: 0.1201 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1128 - val_loss: 0.1173 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1065 - val_loss: 0.1093 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1043 - val_loss: 0.1001 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0926 - val_loss: 0.1042 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0864 - val_loss: 0.1101 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0843 - val_loss: 0.1002 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0816 - val_loss: 0.0866 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0759 - val_loss: 0.0838 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0743 - val_loss: 0.0807 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0717 - val_loss: 0.0816 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.0734 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0690 - val_loss: 0.0704 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0666 - val_loss: 0.0680 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0651 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0625 - val_loss: 0.0651 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0612 - val_loss: 0.0624 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0654 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0650 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0611 - val_loss: 0.0641 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0611 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0562 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0552 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0550 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0548 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0547 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0547 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0546 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0546 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0546 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0546 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0545 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0545 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0545 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0545 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0545 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0545 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0545 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0578 - val_loss: 0.0545 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0545 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0545 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0545 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0587 - val_loss: 0.0545 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0545 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0545 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0545 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0545 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0545 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0545 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0545 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0545 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0545 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0545 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0545 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0545 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0545 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0545 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0579 - val_loss: 0.0545 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0545 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0545 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0545 - lr: 1.3924e-15
Epoch 1/100

2023-11-27 18:33:57.880506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:57.880996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:57.881594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:57.937588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:57.937997: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:57.938409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:58.022053: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:58.022546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:58.022925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:58.085052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:58.085560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:58.085986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:58.319767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:58.320349: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:58.320746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:58.378887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:58.379380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:58.379801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 7ms/step - loss: 0.2223 - val_loss: 0.1817 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1219

2023-11-27 18:33:59.241213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:59.242079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:59.242483: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:33:59.316742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:33:59.317294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:33:59.317714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1722 - val_loss: 0.1525 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1458 - val_loss: 0.1363 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1325 - val_loss: 0.1274 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1234 - val_loss: 0.1191 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1131 - val_loss: 0.1124 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1088 - val_loss: 0.1086 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1051 - val_loss: 0.1054 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1008 - val_loss: 0.1038 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0949 - val_loss: 0.1033 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0887 - val_loss: 0.0917 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0823 - val_loss: 0.0903 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0880 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0771 - val_loss: 0.0867 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.0842 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0671 - val_loss: 0.0840 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0687 - val_loss: 0.0826 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0808 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0636 - val_loss: 0.0795 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0813 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0782 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0739 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0715 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0528 - val_loss: 0.0700 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0693 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0694 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0686 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0687 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0506 - val_loss: 0.0682 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0498 - val_loss: 0.0680 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0677 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0671 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0502 - val_loss: 0.0670 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0669 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0668 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0668 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0667 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0667 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0667 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0666 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0666 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0666 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0666 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0666 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0666 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0666 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0666 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0666 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0666 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0479 - val_loss: 0.0666 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0485 - val_loss: 0.0666 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0493 - val_loss: 0.0666 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0666 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0666 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0666 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0666 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0492 - val_loss: 0.0666 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0666 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0666 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0666 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0666 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0666 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0666 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0489 - val_loss: 0.0666 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0666 - lr: 5.6464e-15
Average Validation Loss: 0.07871851548552514
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:34:22.811567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:22.812026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:22.812591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:22.870582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:22.870998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:22.871351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:22.964817: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:22.965769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:22.966476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:23.033998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:23.034738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:23.035121: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:23.278807: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:23.279279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:23.279887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:23.338061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:23.338525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:23.338934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 41ms/step - loss: 0.2308 - val_loss: 0.2732 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2169

2023-11-27 18:34:23.943549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:23.944309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:23.944769: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:24.012475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:24.013141: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:24.013771: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.2383 - val_loss: 0.2704 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2305 - val_loss: 0.2275 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2140 - val_loss: 0.2163 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1979 - val_loss: 0.2167 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1927 - val_loss: 0.2117 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1851 - val_loss: 0.2037 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1781 - val_loss: 0.1969 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1681 - val_loss: 0.1863 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1530 - val_loss: 0.1858 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1406 - val_loss: 0.1794 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1301 - val_loss: 0.1671 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1235 - val_loss: 0.1614 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1193 - val_loss: 0.1663 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1154 - val_loss: 0.1805 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1198 - val_loss: 0.1516 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1124 - val_loss: 0.1702 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1103 - val_loss: 0.1548 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1050 - val_loss: 0.1597 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1073 - val_loss: 0.1540 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1046 - val_loss: 0.1555 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1020 - val_loss: 0.1554 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1023 - val_loss: 0.1558 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1017 - val_loss: 0.1506 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1013 - val_loss: 0.1527 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1012 - val_loss: 0.1562 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1015 - val_loss: 0.1521 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0986 - val_loss: 0.1502 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0998 - val_loss: 0.1510 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1002 - val_loss: 0.1501 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0994 - val_loss: 0.1499 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0988 - val_loss: 0.1499 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0983 - val_loss: 0.1505 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0991 - val_loss: 0.1511 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0985 - val_loss: 0.1511 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0986 - val_loss: 0.1514 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0989 - val_loss: 0.1511 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1001 - val_loss: 0.1508 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0981 - val_loss: 0.1507 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0998 - val_loss: 0.1508 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0975 - val_loss: 0.1508 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0990 - val_loss: 0.1508 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0986 - val_loss: 0.1508 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0998 - val_loss: 0.1508 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0997 - val_loss: 0.1508 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1000 - val_loss: 0.1508 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0983 - val_loss: 0.1508 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0984 - val_loss: 0.1508 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0993 - val_loss: 0.1508 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1014 - val_loss: 0.1508 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1002 - val_loss: 0.1508 - lr: 2.7536e-08
Epoch 1/100

2023-11-27 18:34:27.044666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.045094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.045625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:27.098842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.099220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.099569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:27.183425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.184255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.185137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:27.253556: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.254169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.254580: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:27.438861: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.439338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.439750: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:27.502294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.503148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.503566: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

14/17 [=======================>......] - ETA: 0s - loss: 0.2746 

2023-11-27 18:34:27.992651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:27.993219: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:27.993716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 2s 51ms/step - loss: 0.2716 - val_loss: 0.1990 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2383 - val_loss: 0.1992 - lr: 0.0010
Epoch 3/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1793

2023-11-27 18:34:28.573068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:28.573803: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:28.574196: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.2150 - val_loss: 0.1637 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2014 - val_loss: 0.1580 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1904 - val_loss: 0.1453 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1754 - val_loss: 0.1460 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1721 - val_loss: 0.1301 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1604 - val_loss: 0.1297 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1448 - val_loss: 0.1354 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1455 - val_loss: 0.1212 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1376 - val_loss: 0.1120 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1232 - val_loss: 0.1123 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1180 - val_loss: 0.1101 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1124 - val_loss: 0.1045 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1085 - val_loss: 0.0993 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1045 - val_loss: 0.0983 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1004 - val_loss: 0.0965 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.0989 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0961 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0926 - val_loss: 0.0950 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.0909 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.0900 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0914 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0908 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0870 - val_loss: 0.0899 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.0905 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0899 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0897 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0900 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0893 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.0895 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.0895 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0893 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0892 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0892 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.0892 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0892 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0892 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.0892 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0892 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0892 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0892 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.0892 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0892 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0860 - val_loss: 0.0892 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0836 - val_loss: 0.0892 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0892 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0832 - val_loss: 0.0892 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0892 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.0892 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0892 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0892 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0892 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0892 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0892 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.0892 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.0892 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.0892 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0892 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0838 - val_loss: 0.0892 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0892 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0892 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.0892 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0892 - lr: 1.3816e-12
Epoch 1/100

2023-11-27 18:34:34.165703: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.166112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.166569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:34.223139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.223506: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.223855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:34.306081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.306551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.306989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:34.366220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.366718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.367148: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:34.608435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.608914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.609502: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:34.668090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:34.668542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:34.668963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.2374 - val_loss: 0.2271 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1682

2023-11-27 18:34:35.337246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:35.337932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:35.338613: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:35.399927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:35.400378: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:35.400776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.2086 - val_loss: 0.1979 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1893 - val_loss: 0.1796 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1735 - val_loss: 0.1592 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 6ms/step - loss: 0.1596 - val_loss: 0.1441 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1493 - val_loss: 0.1379 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1407 - val_loss: 0.1308 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1312 - val_loss: 0.1226 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1224 - val_loss: 0.1161 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1177 - val_loss: 0.1095 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1099 - val_loss: 0.1081 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1061 - val_loss: 0.0969 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.0969 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.0914 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0916 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0919 - val_loss: 0.0895 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0914 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.0877 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0934 - val_loss: 0.0833 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.0833 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0900 - val_loss: 0.0887 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0873 - val_loss: 0.0880 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0815 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0849 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0791 - val_loss: 0.0840 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0787 - val_loss: 0.0840 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0783 - val_loss: 0.0829 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0821 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0769 - val_loss: 0.0823 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0818 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0818 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0816 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0816 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0813 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0813 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0816 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0815 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0759 - val_loss: 0.0816 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0815 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0815 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0815 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0815 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0815 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0763 - val_loss: 0.0815 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0764 - val_loss: 0.0815 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0815 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0757 - val_loss: 0.0815 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0815 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0815 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0815 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0815 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0815 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0765 - val_loss: 0.0815 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0758 - val_loss: 0.0815 - lr: 6.1442e-09
Epoch 1/100

2023-11-27 18:34:42.556389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:42.556777: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:42.557377: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:42.612677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:42.612996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:42.613343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:42.694005: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:42.694481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:42.694904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:42.754284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:42.754755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:42.755179: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:42.987365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:42.987891: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:42.988432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:43.045825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:43.046271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:43.046720: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 13ms/step - loss: 0.2372 - val_loss: 0.2074 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1768

2023-11-27 18:34:43.749249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:43.749674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:43.750298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:43.813930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:43.814612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:43.815134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1990 - val_loss: 0.2002 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1782 - val_loss: 0.1734 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1572 - val_loss: 0.1561 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1433 - val_loss: 0.1321 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1324 - val_loss: 0.1292 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1211 - val_loss: 0.1143 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1153 - val_loss: 0.1110 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1083 - val_loss: 0.1034 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1013 - val_loss: 0.1002 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.0959 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0941 - val_loss: 0.0911 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0895 - val_loss: 0.0868 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.0827 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.0770 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0800 - val_loss: 0.0779 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0735 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0760 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.0718 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0708 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0718 - val_loss: 0.0728 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0742 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0729 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0703 - val_loss: 0.0731 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0758 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0669 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0729 - val_loss: 0.0602 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0698 - val_loss: 0.0594 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0691 - val_loss: 0.0595 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0589 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0590 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0669 - val_loss: 0.0589 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0589 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.0589 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0588 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0662 - val_loss: 0.0587 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0662 - val_loss: 0.0587 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0671 - val_loss: 0.0587 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0671 - val_loss: 0.0587 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0587 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0670 - val_loss: 0.0587 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0677 - val_loss: 0.0587 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0587 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0587 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0669 - val_loss: 0.0587 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0662 - val_loss: 0.0587 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0587 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0671 - val_loss: 0.0587 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0675 - val_loss: 0.0587 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0587 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0587 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0587 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0587 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0587 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0587 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.0587 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0587 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0587 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0587 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0669 - val_loss: 0.0587 - lr: 1.6788e-10
Epoch 1/100

2023-11-27 18:34:53.966407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:53.966809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:53.967326: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:54.021340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:54.021712: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:54.022060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:54.101776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:54.102234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:54.102646: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:54.162305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:54.162756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:54.163173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:54.394042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:54.394505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:54.395032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:54.452584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:54.453048: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:54.453484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.2402 - val_loss: 0.2035 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1564

2023-11-27 18:34:55.186346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:55.186830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:55.187459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:34:55.248456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:34:55.248964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:34:55.249332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1950 - val_loss: 0.1748 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1673 - val_loss: 0.1506 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1478 - val_loss: 0.1361 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1343 - val_loss: 0.1256 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1265 - val_loss: 0.1223 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1151 - val_loss: 0.1150 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1038 - val_loss: 0.1093 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0975 - val_loss: 0.1016 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0905 - val_loss: 0.1096 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0924 - val_loss: 0.1113 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.0985 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.1005 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0869 - val_loss: 0.0930 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0810 - val_loss: 0.0940 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0906 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0748 - val_loss: 0.0845 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0836 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0806 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0673 - val_loss: 0.0801 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0771 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0756 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0755 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0624 - val_loss: 0.0750 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0613 - val_loss: 0.0744 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0746 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0618 - val_loss: 0.0740 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0612 - val_loss: 0.0737 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0732 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0729 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0727 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0727 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0599 - val_loss: 0.0726 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0726 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0726 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0726 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0726 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0726 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0726 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0725 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0598 - val_loss: 0.0725 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0725 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0725 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0725 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0725 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0725 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0725 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0725 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0725 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0725 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0725 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0725 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0725 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0725 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0725 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0725 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0725 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0725 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0587 - val_loss: 0.0725 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0725 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0725 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0725 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0725 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0725 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0586 - val_loss: 0.0725 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0725 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0725 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0594 - val_loss: 0.0725 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0725 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0725 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0585 - val_loss: 0.0725 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0725 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0725 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0591 - val_loss: 0.0725 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0725 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0725 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0725 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0592 - val_loss: 0.0725 - lr: 2.8039e-15
Average Validation Loss: 0.09031226113438606
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:35:11.030988: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.031407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.032036: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:11.086255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.086678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.087134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:11.170416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.170904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.171331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:11.230469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.230918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.231346: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:11.482246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.482812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.483244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:11.544186: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:11.544630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:11.545069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.2465 - val_loss: 0.2555 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.2293

2023-11-27 18:35:12.107174: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:12.107673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:12.108158: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:12.169311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:12.169739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:12.170132: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 10ms/step - loss: 0.2265 - val_loss: 0.2689 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2341 - val_loss: 0.2621 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2246 - val_loss: 0.2447 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2125 - val_loss: 0.2300 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 9ms/step - loss: 0.2064 - val_loss: 0.2238 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2000 - val_loss: 0.2214 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1932 - val_loss: 0.2206 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1875 - val_loss: 0.2150 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1785 - val_loss: 0.2074 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1694 - val_loss: 0.1995 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1612 - val_loss: 0.1914 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1538 - val_loss: 0.1876 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1444 - val_loss: 0.1847 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1381 - val_loss: 0.1787 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1316 - val_loss: 0.1826 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1304 - val_loss: 0.1803 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1281 - val_loss: 0.1771 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1259 - val_loss: 0.1795 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1239 - val_loss: 0.1757 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1764 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1202 - val_loss: 0.1759 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1206 - val_loss: 0.1750 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1195 - val_loss: 0.1749 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1200 - val_loss: 0.1752 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1180 - val_loss: 0.1739 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1196 - val_loss: 0.1719 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1180 - val_loss: 0.1723 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1194 - val_loss: 0.1735 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1179 - val_loss: 0.1748 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1179 - val_loss: 0.1745 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1174 - val_loss: 0.1735 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1174 - val_loss: 0.1727 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1166 - val_loss: 0.1723 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 12ms/step - loss: 0.1193 - val_loss: 0.1723 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1176 - val_loss: 0.1723 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1179 - val_loss: 0.1723 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1165 - val_loss: 0.1724 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1184 - val_loss: 0.1725 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1188 - val_loss: 0.1725 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1185 - val_loss: 0.1725 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1183 - val_loss: 0.1726 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1184 - val_loss: 0.1726 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1184 - val_loss: 0.1726 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1171 - val_loss: 0.1726 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1187 - val_loss: 0.1726 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1172 - val_loss: 0.1726 - lr: 1.5073e-07
Epoch 1/100

2023-11-27 18:35:14.577113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:14.577752: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:14.578125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:14.631175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:14.631569: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:14.631915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:14.715254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:14.715731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:14.716162: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:14.775435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:14.775888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:14.776295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:15.027636: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:15.028279: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:15.028759: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:15.086908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:15.087385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:15.087809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 38ms/step - loss: 0.2560 - val_loss: 0.1994 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2456

2023-11-27 18:35:15.668705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:15.669185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:15.669835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:15.731738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:15.732173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:15.732562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.2390 - val_loss: 0.2107 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2230 - val_loss: 0.1750 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2089 - val_loss: 0.1751 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1956 - val_loss: 0.1825 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1835 - val_loss: 0.1883 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1779 - val_loss: 0.1725 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1658 - val_loss: 0.1725 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1604 - val_loss: 0.1685 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1549 - val_loss: 0.1590 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1470 - val_loss: 0.1520 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1408 - val_loss: 0.1557 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1352 - val_loss: 0.1536 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1316 - val_loss: 0.1470 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1285 - val_loss: 0.1404 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1265 - val_loss: 0.1449 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1242 - val_loss: 0.1381 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1235 - val_loss: 0.1307 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1204 - val_loss: 0.1374 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1171 - val_loss: 0.1312 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1158 - val_loss: 0.1322 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1160 - val_loss: 0.1319 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1127 - val_loss: 0.1284 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1129 - val_loss: 0.1321 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1131 - val_loss: 0.1257 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1117 - val_loss: 0.1289 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1111 - val_loss: 0.1285 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1110 - val_loss: 0.1259 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1106 - val_loss: 0.1285 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1107 - val_loss: 0.1287 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1109 - val_loss: 0.1280 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1101 - val_loss: 0.1264 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1099 - val_loss: 0.1264 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1101 - val_loss: 0.1269 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1097 - val_loss: 0.1269 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1084 - val_loss: 0.1270 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1105 - val_loss: 0.1272 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1101 - val_loss: 0.1272 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1093 - val_loss: 0.1273 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1089 - val_loss: 0.1273 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1105 - val_loss: 0.1272 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1102 - val_loss: 0.1272 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1086 - val_loss: 0.1271 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1100 - val_loss: 0.1272 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1096 - val_loss: 0.1272 - lr: 3.3546e-07
Epoch 1/100

2023-11-27 18:35:19.076399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.077228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.077642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:19.136008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.136466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.136906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:19.218239: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.218779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.219213: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:19.280681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.281309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.281755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:19.516018: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.516471: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.516906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:19.574645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:19.575086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:19.575530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 26ms/step - loss: 0.2475 - val_loss: 0.2326 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2448

2023-11-27 18:35:20.187568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:20.188087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:20.188779: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:20.249390: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:20.249760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:20.250145: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.2264 - val_loss: 0.2288 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 7ms/step - loss: 0.2018 - val_loss: 0.2005 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1933 - val_loss: 0.1871 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1783 - val_loss: 0.1730 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1688 - val_loss: 0.1590 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1634 - val_loss: 0.1504 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1534 - val_loss: 0.1434 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1440 - val_loss: 0.1361 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1388 - val_loss: 0.1315 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1325 - val_loss: 0.1285 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1311 - val_loss: 0.1208 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1232 - val_loss: 0.1173 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1148 - val_loss: 0.1112 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1137 - val_loss: 0.1076 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1097 - val_loss: 0.1073 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1092 - val_loss: 0.1036 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1084 - val_loss: 0.1001 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1055 - val_loss: 0.0989 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1022 - val_loss: 0.0983 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1008 - val_loss: 0.0980 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0976 - val_loss: 0.0962 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0963 - val_loss: 0.0947 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0961 - val_loss: 0.0937 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0959 - val_loss: 0.0939 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0948 - val_loss: 0.0931 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0939 - val_loss: 0.0946 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0941 - val_loss: 0.0926 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0933 - val_loss: 0.0929 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0935 - val_loss: 0.0929 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0940 - val_loss: 0.0924 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0938 - val_loss: 0.0924 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0944 - val_loss: 0.0923 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0916 - val_loss: 0.0926 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0933 - val_loss: 0.0925 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0937 - val_loss: 0.0924 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0926 - val_loss: 0.0925 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0933 - val_loss: 0.0925 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0927 - val_loss: 0.0924 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0925 - val_loss: 0.0924 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0938 - val_loss: 0.0924 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0937 - val_loss: 0.0925 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0925 - val_loss: 0.0925 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0926 - val_loss: 0.0925 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0929 - val_loss: 0.0925 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0933 - val_loss: 0.0925 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0935 - val_loss: 0.0925 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0927 - val_loss: 0.0925 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0926 - val_loss: 0.0925 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0930 - val_loss: 0.0925 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0935 - val_loss: 0.0925 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0926 - val_loss: 0.0925 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0935 - val_loss: 0.0925 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:35:25.577056: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:25.577513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:25.578045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:25.632641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:25.632999: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:25.633364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:25.713223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:25.713705: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:25.714125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:25.774197: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:25.774656: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:25.775072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:26.007433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:26.007889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:26.008448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:26.066770: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:26.067218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:26.067639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 23ms/step - loss: 0.2674 - val_loss: 0.2393 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2717

2023-11-27 18:35:26.714721: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:26.715373: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:26.715889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:26.776330: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:26.776788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:26.777173: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 7ms/step - loss: 0.2253 - val_loss: 0.2013 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1961 - val_loss: 0.1949 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1827 - val_loss: 0.2196 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1808 - val_loss: 0.1870 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1672 - val_loss: 0.1543 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1479 - val_loss: 0.1673 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1441 - val_loss: 0.1846 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1491 - val_loss: 0.1546 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1395 - val_loss: 0.1262 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1231 - val_loss: 0.1418 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1218 - val_loss: 0.1441 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1401 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1205 - val_loss: 0.1123 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1080 - val_loss: 0.1143 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1045 - val_loss: 0.1188 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1036 - val_loss: 0.1126 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 9ms/step - loss: 0.1017 - val_loss: 0.1089 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1010 - val_loss: 0.1014 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0969 - val_loss: 0.0949 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0936 - val_loss: 0.0932 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0929 - val_loss: 0.0864 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0899 - val_loss: 0.0839 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0896 - val_loss: 0.0829 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0884 - val_loss: 0.0813 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0876 - val_loss: 0.0812 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0882 - val_loss: 0.0796 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.0810 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0790 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0865 - val_loss: 0.0792 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0856 - val_loss: 0.0791 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0789 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.0788 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0788 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0786 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.0786 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0786 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0854 - val_loss: 0.0786 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0853 - val_loss: 0.0786 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0786 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0786 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0851 - val_loss: 0.0786 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0785 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0785 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0852 - val_loss: 0.0785 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0785 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.0785 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0862 - val_loss: 0.0785 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0857 - val_loss: 0.0785 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0859 - val_loss: 0.0785 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0868 - val_loss: 0.0785 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.0785 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0855 - val_loss: 0.0785 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0852 - val_loss: 0.0785 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0859 - val_loss: 0.0785 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0849 - val_loss: 0.0785 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0785 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0849 - val_loss: 0.0785 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0864 - val_loss: 0.0785 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0855 - val_loss: 0.0785 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0854 - val_loss: 0.0785 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0863 - val_loss: 0.0785 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0864 - val_loss: 0.0785 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0848 - val_loss: 0.0785 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0861 - val_loss: 0.0785 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0852 - val_loss: 0.0785 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0848 - val_loss: 0.0785 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0852 - val_loss: 0.0785 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0860 - val_loss: 0.0785 - lr: 3.7654e-13
Epoch 1/100

2023-11-27 18:35:35.877399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:35.877820: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:35.878368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:35.929765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:35.930150: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:35.930481: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:36.010828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:36.011318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:36.011730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:36.071253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:36.071849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:36.072307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:36.305101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:36.305555: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:36.305994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:36.364474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:36.364932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:36.365338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 2s 18ms/step - loss: 0.2360 - val_loss: 0.2188 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2098

2023-11-27 18:35:37.558324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:37.558814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:37.559496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:37.620814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:37.621266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:37.621666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.2036 - val_loss: 0.2038 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1915 - val_loss: 0.1902 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1799 - val_loss: 0.1836 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1668 - val_loss: 0.1683 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1533 - val_loss: 0.1598 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1467 - val_loss: 0.1547 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1375 - val_loss: 0.1491 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1367 - val_loss: 0.1465 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1309 - val_loss: 0.1428 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1236 - val_loss: 0.1348 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1139 - val_loss: 0.1328 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1149 - val_loss: 0.1341 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1103 - val_loss: 0.1299 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1075 - val_loss: 0.1249 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1016 - val_loss: 0.1203 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0972 - val_loss: 0.1192 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0953 - val_loss: 0.1162 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0911 - val_loss: 0.1126 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0894 - val_loss: 0.1120 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0873 - val_loss: 0.1076 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0846 - val_loss: 0.1030 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0821 - val_loss: 0.1012 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0800 - val_loss: 0.0991 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0801 - val_loss: 0.0983 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0784 - val_loss: 0.0973 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0783 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0779 - val_loss: 0.0961 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0779 - val_loss: 0.0956 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0774 - val_loss: 0.0953 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0775 - val_loss: 0.0951 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0949 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0768 - val_loss: 0.0949 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0768 - val_loss: 0.0947 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0946 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0946 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0946 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0768 - val_loss: 0.0945 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0760 - val_loss: 0.0945 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0945 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0945 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0945 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0769 - val_loss: 0.0945 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0766 - val_loss: 0.0945 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0945 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0769 - val_loss: 0.0945 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0945 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0945 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0945 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.0945 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0771 - val_loss: 0.0945 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0945 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0945 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0757 - val_loss: 0.0945 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.0945 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0763 - val_loss: 0.0945 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0945 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0765 - val_loss: 0.0945 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0945 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0758 - val_loss: 0.0945 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0945 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0766 - val_loss: 0.0945 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0768 - val_loss: 0.0945 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0757 - val_loss: 0.0945 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.0945 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0767 - val_loss: 0.0945 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0764 - val_loss: 0.0945 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0765 - val_loss: 0.0945 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0945 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0945 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0759 - val_loss: 0.0945 - lr: 1.1370e-14
Average Validation Loss: 0.11257875859737396
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:35:49.517689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:49.518275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:49.518643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:49.575236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:49.575715: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:49.576042: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:49.660677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:49.661164: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:49.661591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:49.722031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:49.722625: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:49.723263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:49.959507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:49.960064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:49.960672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:50.028014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:50.028496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:50.028878: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.2183 - val_loss: 0.2458 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.2166

2023-11-27 18:35:50.662600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:50.663110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:50.663773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:50.725177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:50.725622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:50.725996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.2169 - val_loss: 0.2191 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1956 - val_loss: 0.2071 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1842 - val_loss: 0.1971 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1684 - val_loss: 0.1952 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1643 - val_loss: 0.1881 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1566 - val_loss: 0.1702 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1383 - val_loss: 0.1569 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1244 - val_loss: 0.1500 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1116 - val_loss: 0.1553 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1073 - val_loss: 0.1435 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1021 - val_loss: 0.1519 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.1394 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0963 - val_loss: 0.1461 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.1451 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0939 - val_loss: 0.1319 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.1319 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0904 - val_loss: 0.1518 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.1382 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0912 - val_loss: 0.1275 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.1346 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0855 - val_loss: 0.1329 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0852 - val_loss: 0.1291 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0847 - val_loss: 0.1328 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0826 - val_loss: 0.1302 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0823 - val_loss: 0.1303 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0827 - val_loss: 0.1287 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.1269 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1299 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.1293 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0824 - val_loss: 0.1287 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.1282 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0819 - val_loss: 0.1277 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1284 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0819 - val_loss: 0.1288 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.1289 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.1289 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0825 - val_loss: 0.1288 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0821 - val_loss: 0.1284 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0802 - val_loss: 0.1284 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0811 - val_loss: 0.1284 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0813 - val_loss: 0.1284 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0817 - val_loss: 0.1284 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.1284 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.1285 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0811 - val_loss: 0.1284 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0815 - val_loss: 0.1284 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0807 - val_loss: 0.1284 - lr: 1.0104e-07
Epoch 1/100

2023-11-27 18:35:54.813836: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:54.814259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:54.814728: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:54.872498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:54.872914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:54.873270: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:54.953154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:54.953638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:54.954059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:55.013594: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:55.014074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:55.014559: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:55.195226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:55.195679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:55.196131: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:55.253259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:55.253723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:55.254139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.2485 - val_loss: 0.1942 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1435

2023-11-27 18:35:55.761473: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:55.761905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:55.762336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:35:55.828751: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:35:55.829572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:35:55.830223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.2158 - val_loss: 0.1608 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1969 - val_loss: 0.1465 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1856 - val_loss: 0.1298 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1707 - val_loss: 0.1270 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1667 - val_loss: 0.1151 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1571 - val_loss: 0.1129 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1530 - val_loss: 0.1022 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1468 - val_loss: 0.1084 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1442 - val_loss: 0.0948 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1334 - val_loss: 0.1106 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1307 - val_loss: 0.0895 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1229 - val_loss: 0.1168 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1152 - val_loss: 0.0929 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1138 - val_loss: 0.1016 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1071 - val_loss: 0.0957 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1016 - val_loss: 0.0920 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0985 - val_loss: 0.0859 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0951 - val_loss: 0.0840 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0915 - val_loss: 0.0818 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0860 - val_loss: 0.0781 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0830 - val_loss: 0.0757 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0810 - val_loss: 0.0757 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0788 - val_loss: 0.0774 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0780 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0748 - val_loss: 0.0788 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0740 - val_loss: 0.0803 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0739 - val_loss: 0.0813 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0728 - val_loss: 0.0809 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0719 - val_loss: 0.0804 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0734 - val_loss: 0.0821 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0694 - val_loss: 0.0814 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0703 - val_loss: 0.0814 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0815 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0819 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0816 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0715 - val_loss: 0.0815 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0814 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0708 - val_loss: 0.0815 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0711 - val_loss: 0.0817 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0695 - val_loss: 0.0817 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0700 - val_loss: 0.0817 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:36:00.419926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.420563: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.421011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:00.480070: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.480498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.480887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:00.563561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.564169: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.564629: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:00.625775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.626413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.626902: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:00.873547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.874461: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.875012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:00.935347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:00.935840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:00.936275: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.2186 - val_loss: 0.1966 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.2070

2023-11-27 18:36:01.663863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:01.664322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:01.664951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:01.725448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:01.725892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:01.726271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1903 - val_loss: 0.1739 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1687 - val_loss: 0.1555 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1559 - val_loss: 0.1429 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1461 - val_loss: 0.1370 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1368 - val_loss: 0.1271 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1339 - val_loss: 0.1294 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1284 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1231 - val_loss: 0.1187 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1191 - val_loss: 0.1109 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1090 - val_loss: 0.1089 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1074 - val_loss: 0.1016 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0974 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0937 - val_loss: 0.0925 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0864 - val_loss: 0.0849 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0849 - val_loss: 0.0823 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0785 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0752 - val_loss: 0.0783 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0714 - val_loss: 0.0757 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0705 - val_loss: 0.0745 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0706 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0644 - val_loss: 0.0725 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0658 - val_loss: 0.0718 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0687 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0657 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0661 - val_loss: 0.0654 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0634 - val_loss: 0.0657 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0661 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0621 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0606 - val_loss: 0.0664 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0608 - val_loss: 0.0665 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0607 - val_loss: 0.0662 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0666 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0665 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0598 - val_loss: 0.0666 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0602 - val_loss: 0.0664 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0664 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0592 - val_loss: 0.0664 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0588 - val_loss: 0.0664 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0590 - val_loss: 0.0664 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0664 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0593 - val_loss: 0.0664 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0596 - val_loss: 0.0664 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0585 - val_loss: 0.0664 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0664 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0594 - val_loss: 0.0664 - lr: 2.2487e-07
Epoch 1/100

2023-11-27 18:36:10.456324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.456742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.457267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:10.513446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.513810: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.514258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:10.597913: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.598446: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.599199: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:10.668097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.668622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.669147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:10.917480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.918039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.918734: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:10.976421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:10.976886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:10.977294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.2099 - val_loss: 0.1974 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.2065

2023-11-27 18:36:11.770846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:11.771277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:11.771681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:11.832711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:11.833147: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:11.833528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1735 - val_loss: 0.1589 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1513 - val_loss: 0.1442 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1394 - val_loss: 0.1350 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1285 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1177 - val_loss: 0.1119 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1101 - val_loss: 0.1055 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1054 - val_loss: 0.1008 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1005 - val_loss: 0.0926 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0965 - val_loss: 0.0905 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0929 - val_loss: 0.0857 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0866 - val_loss: 0.0858 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0843 - val_loss: 0.0827 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0804 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0757 - val_loss: 0.0789 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0736 - val_loss: 0.0769 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0713 - val_loss: 0.0731 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0692 - val_loss: 0.0715 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0675 - val_loss: 0.0716 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0646 - val_loss: 0.0696 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0639 - val_loss: 0.0714 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0733 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0707 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0622 - val_loss: 0.0712 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0627 - val_loss: 0.0696 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0670 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0617 - val_loss: 0.0647 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0609 - val_loss: 0.0633 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0599 - val_loss: 0.0615 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0591 - val_loss: 0.0600 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0583 - val_loss: 0.0593 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0586 - val_loss: 0.0584 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0582 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0579 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0578 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0577 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0577 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0577 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0576 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0576 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0567 - val_loss: 0.0576 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0576 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0576 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0576 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0572 - val_loss: 0.0576 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0576 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0576 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0576 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0576 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0576 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0573 - val_loss: 0.0576 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0576 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0576 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0576 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0576 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0576 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0576 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0576 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0576 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0576 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0565 - val_loss: 0.0576 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0571 - val_loss: 0.0576 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0576 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0560 - val_loss: 0.0576 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0576 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0562 - val_loss: 0.0576 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0576 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0576 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0566 - val_loss: 0.0576 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0576 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0574 - val_loss: 0.0576 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0570 - val_loss: 0.0576 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0564 - val_loss: 0.0576 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0576 - val_loss: 0.0576 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 1.3924e-15
Epoch 1/100

2023-11-27 18:36:31.251664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.252094: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.252675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:31.303731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.304115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.304456: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:31.384706: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.385185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.385570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:31.445615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.446112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.446595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:31.685652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.686168: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.686601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:31.745435: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:31.745936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:31.746363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 7ms/step - loss: 0.2150 - val_loss: 0.1776 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.1209

2023-11-27 18:36:32.598756: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:32.599425: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:32.599901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:32.660621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:32.661045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:32.661432: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1681 - val_loss: 0.1507 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1469 - val_loss: 0.1377 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1317 - val_loss: 0.1295 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1233 - val_loss: 0.1226 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1155 - val_loss: 0.1163 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1086 - val_loss: 0.1124 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.1023 - val_loss: 0.1083 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0974 - val_loss: 0.1040 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0940 - val_loss: 0.1013 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0846 - val_loss: 0.0984 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0795 - val_loss: 0.0951 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0761 - val_loss: 0.0925 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0760 - val_loss: 0.0869 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0699 - val_loss: 0.0849 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0672 - val_loss: 0.0843 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0805 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0630 - val_loss: 0.0793 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0618 - val_loss: 0.0761 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0604 - val_loss: 0.0755 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0730 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0563 - val_loss: 0.0715 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0551 - val_loss: 0.0691 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0529 - val_loss: 0.0678 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0666 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0509 - val_loss: 0.0657 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0652 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0497 - val_loss: 0.0652 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0496 - val_loss: 0.0651 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0499 - val_loss: 0.0642 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0495 - val_loss: 0.0642 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0495 - val_loss: 0.0635 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0492 - val_loss: 0.0633 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0632 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0632 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0490 - val_loss: 0.0632 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0631 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0631 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0632 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0483 - val_loss: 0.0632 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0632 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0632 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0632 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0632 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0632 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0481 - val_loss: 0.0632 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0482 - val_loss: 0.0632 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0632 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0632 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0632 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0487 - val_loss: 0.0632 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0632 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0632 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0632 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0632 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0632 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0632 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0632 - lr: 8.3153e-10
Average Validation Loss: 0.07774390503764153
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:36:50.182016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.182755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.183415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:50.241814: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.242220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.242605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:50.329578: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.330255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.331049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:50.393824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.394363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.394892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:50.650218: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.650693: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.651139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:50.712983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:50.713504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:50.713990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 37ms/step - loss: 0.2410 - val_loss: 0.2619 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2024

2023-11-27 18:36:51.318738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:51.319412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:51.319956: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:51.381651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:51.382080: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:51.382474: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.2327 - val_loss: 0.2699 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2226 - val_loss: 0.2330 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.2085 - val_loss: 0.2165 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1973 - val_loss: 0.2111 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1876 - val_loss: 0.2104 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1838 - val_loss: 0.2054 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1768 - val_loss: 0.1971 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1691 - val_loss: 0.1919 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1598 - val_loss: 0.1875 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1503 - val_loss: 0.1801 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1325 - val_loss: 0.1750 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1246 - val_loss: 0.1706 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1717 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1134 - val_loss: 0.1715 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1115 - val_loss: 0.1689 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1097 - val_loss: 0.1673 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1063 - val_loss: 0.1676 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1061 - val_loss: 0.1599 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1026 - val_loss: 0.1681 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1028 - val_loss: 0.1538 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1016 - val_loss: 0.1668 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1012 - val_loss: 0.1574 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1005 - val_loss: 0.1585 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0996 - val_loss: 0.1556 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0996 - val_loss: 0.1587 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0991 - val_loss: 0.1588 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1002 - val_loss: 0.1597 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0976 - val_loss: 0.1600 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0995 - val_loss: 0.1590 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0979 - val_loss: 0.1574 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0985 - val_loss: 0.1577 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0970 - val_loss: 0.1578 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0973 - val_loss: 0.1582 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0968 - val_loss: 0.1577 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0986 - val_loss: 0.1574 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0982 - val_loss: 0.1573 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0978 - val_loss: 0.1574 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0978 - val_loss: 0.1574 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0980 - val_loss: 0.1574 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0979 - val_loss: 0.1573 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:36:53.861277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:53.861679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:53.862258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:53.920934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:53.921360: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:53.921723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:54.002284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.002766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.003188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:54.062591: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.063088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.063622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:54.247133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.247585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.247989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:54.308068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.309231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.309709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.2644 - val_loss: 0.1937 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2031

2023-11-27 18:36:54.799383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.799967: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.800401: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:54.861345: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:54.861774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:54.862159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.2242 - val_loss: 0.1807 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.2072 - val_loss: 0.1607 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1953 - val_loss: 0.1513 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1844 - val_loss: 0.1505 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1698 - val_loss: 0.1449 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1615 - val_loss: 0.1390 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1523 - val_loss: 0.1376 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1393 - val_loss: 0.1560 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1380 - val_loss: 0.1306 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1328 - val_loss: 0.1224 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1191 - val_loss: 0.1401 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1151 - val_loss: 0.1374 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1179 - val_loss: 0.1204 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1080 - val_loss: 0.1222 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1048 - val_loss: 0.1210 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1023 - val_loss: 0.1235 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1011 - val_loss: 0.1185 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0972 - val_loss: 0.1136 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0940 - val_loss: 0.1173 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0927 - val_loss: 0.1097 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0938 - val_loss: 0.1085 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0885 - val_loss: 0.1098 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0888 - val_loss: 0.1089 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0876 - val_loss: 0.1076 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.1052 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.1090 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0863 - val_loss: 0.1049 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0871 - val_loss: 0.1060 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0853 - val_loss: 0.1055 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0849 - val_loss: 0.1070 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.1066 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0851 - val_loss: 0.1060 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0856 - val_loss: 0.1055 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.1048 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1044 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.1041 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.1042 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.1043 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.1042 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0861 - val_loss: 0.1041 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 6ms/step - loss: 0.0849 - val_loss: 0.1041 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1041 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.1041 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.1041 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1042 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.1042 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.1042 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.1042 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0844 - val_loss: 0.1042 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0837 - val_loss: 0.1042 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0847 - val_loss: 0.1042 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.1042 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1042 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0842 - val_loss: 0.1042 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.1042 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0846 - val_loss: 0.1042 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.1042 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0856 - val_loss: 0.1042 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.1042 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0850 - val_loss: 0.1042 - lr: 1.6788e-10
Epoch 1/100

2023-11-27 18:36:59.765319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:59.765865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:59.766300: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:59.824936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:59.825311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:59.825685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:59.912442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:59.912872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:59.913352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:36:59.974851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:36:59.975785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:36:59.976226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:00.230754: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:00.231212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:00.231639: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:00.290641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:00.291111: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:00.291528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 2s 36ms/step - loss: 0.2297 - val_loss: 0.2116 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.1611

2023-11-27 18:37:01.472798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:01.473344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:01.473994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:01.534795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:01.535227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:01.535603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 6ms/step - loss: 0.1973 - val_loss: 0.1828 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1828 - val_loss: 0.1672 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1671 - val_loss: 0.1530 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1562 - val_loss: 0.1419 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1479 - val_loss: 0.1348 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1405 - val_loss: 0.1279 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1335 - val_loss: 0.1228 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1276 - val_loss: 0.1164 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 6ms/step - loss: 0.1190 - val_loss: 0.1095 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1132 - val_loss: 0.1029 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1059 - val_loss: 0.0907 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0983 - val_loss: 0.0960 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0825 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0907 - val_loss: 0.0881 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0880 - val_loss: 0.0825 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0867 - val_loss: 0.0811 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0819 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0826 - val_loss: 0.0813 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0829 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0794 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0853 - val_loss: 0.0749 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0857 - val_loss: 0.0778 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0845 - val_loss: 0.0836 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0801 - val_loss: 0.0813 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0781 - val_loss: 0.0808 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0775 - val_loss: 0.0793 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0794 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0787 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0750 - val_loss: 0.0798 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0762 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0782 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.0782 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0780 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0754 - val_loss: 0.0778 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0778 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0778 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0777 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0738 - val_loss: 0.0777 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0743 - val_loss: 0.0777 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0746 - val_loss: 0.0777 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0777 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:37:07.141945: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.142408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.142865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:07.201551: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.201968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.202353: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:07.283084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.283570: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.284011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:07.347704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.348452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.348957: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:07.586835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.587398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.587953: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:07.645968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:07.646447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:07.646856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.2233 - val_loss: 0.1956 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.1624

2023-11-27 18:37:08.344084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:08.344684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:08.345075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:08.406013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:08.406495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:08.406872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1885 - val_loss: 0.1873 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1736 - val_loss: 0.1720 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1549 - val_loss: 0.1557 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1436 - val_loss: 0.1373 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1321 - val_loss: 0.1320 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1240 - val_loss: 0.1194 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1149 - val_loss: 0.1114 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1075 - val_loss: 0.1043 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1024 - val_loss: 0.0978 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0967 - val_loss: 0.0955 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0943 - val_loss: 0.0920 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.0880 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0859 - val_loss: 0.0865 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0824 - val_loss: 0.0806 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0841 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0813 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0875 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0775 - val_loss: 0.0785 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0771 - val_loss: 0.0923 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0899 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0996 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0835 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0843 - val_loss: 0.0755 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0803 - val_loss: 0.0690 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0681 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0767 - val_loss: 0.0671 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0665 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0736 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0726 - val_loss: 0.0660 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0727 - val_loss: 0.0659 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0656 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0654 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0654 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0653 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0653 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0652 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0697 - val_loss: 0.0652 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0652 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0699 - val_loss: 0.0652 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0652 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0652 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0652 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0652 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0652 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0652 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0652 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0712 - val_loss: 0.0652 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0652 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0652 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0706 - val_loss: 0.0652 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0714 - val_loss: 0.0652 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0652 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0652 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0652 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0652 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0716 - val_loss: 0.0652 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0707 - val_loss: 0.0652 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0652 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0652 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0652 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0652 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0720 - val_loss: 0.0652 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0652 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0652 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0652 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.0652 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0711 - val_loss: 0.0652 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0652 - lr: 1.1370e-14
Epoch 1/100

2023-11-27 18:37:21.015258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.015853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.016415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:21.074362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.074794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.075221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:21.159788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.160284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.160871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:21.221918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.222418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.222847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:21.455547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.455994: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.456590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:21.514824: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:21.515304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:21.515724: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 11ms/step - loss: 0.2248 - val_loss: 0.1946 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.1499

2023-11-27 18:37:22.254684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:22.255194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:22.255740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:22.319984: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:22.320482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:22.320888: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1815 - val_loss: 0.1701 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1570 - val_loss: 0.1550 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1409 - val_loss: 0.1443 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1298 - val_loss: 0.1358 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1218 - val_loss: 0.1289 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1112 - val_loss: 0.1212 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0987 - val_loss: 0.1116 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0971 - val_loss: 0.1243 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.1040 - val_loss: 0.1225 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0986 - val_loss: 0.1163 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0965 - val_loss: 0.1150 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0938 - val_loss: 0.1117 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0897 - val_loss: 0.1091 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.1005 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0991 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0779 - val_loss: 0.0981 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0759 - val_loss: 0.0969 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0747 - val_loss: 0.0908 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0722 - val_loss: 0.0883 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0875 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0869 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0855 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0658 - val_loss: 0.0848 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0660 - val_loss: 0.0843 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0835 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0835 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0657 - val_loss: 0.0829 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0820 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0656 - val_loss: 0.0816 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0812 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0810 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0810 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0809 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0808 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0808 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0636 - val_loss: 0.0808 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0808 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0641 - val_loss: 0.0808 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0808 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0808 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0807 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0807 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0807 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0807 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0807 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0807 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0625 - val_loss: 0.0807 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0807 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0807 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0636 - val_loss: 0.0807 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0807 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0807 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0807 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0807 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0807 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0807 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0807 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0807 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0807 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0807 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0807 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0638 - val_loss: 0.0807 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0627 - val_loss: 0.0807 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0807 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0807 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0630 - val_loss: 0.0807 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0635 - val_loss: 0.0807 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0807 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0807 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0632 - val_loss: 0.0807 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0807 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0633 - val_loss: 0.0807 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0631 - val_loss: 0.0807 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.0807 - lr: 2.2897e-14
Average Validation Loss: 0.09573676884174347
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:37:37.514233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:37.514667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:37.515253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:37.569637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:37.570139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:37.570451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:37.656466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:37.656899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:37.657305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:37.719463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:37.720071: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:37.720522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:37.952795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:37.953268: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:37.953727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:38.011979: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:38.012442: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:38.012849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 71ms/step - loss: 0.2753 - val_loss: 0.2397 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.2063

2023-11-27 18:37:38.581006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:38.581491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:38.582149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:38.645278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:38.645709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:38.646090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.2131 - val_loss: 0.2527 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2193 - val_loss: 0.2576 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2194 - val_loss: 0.2440 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2111 - val_loss: 0.2282 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 10ms/step - loss: 0.2034 - val_loss: 0.2193 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1996 - val_loss: 0.2158 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1849 - val_loss: 0.2157 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1840 - val_loss: 0.2142 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1788 - val_loss: 0.2070 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1684 - val_loss: 0.1972 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1553 - val_loss: 0.1959 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1505 - val_loss: 0.1914 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1439 - val_loss: 0.1865 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1400 - val_loss: 0.1930 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 9ms/step - loss: 0.1375 - val_loss: 0.1868 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1336 - val_loss: 0.1841 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1320 - val_loss: 0.1782 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1312 - val_loss: 0.1813 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1294 - val_loss: 0.1834 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1281 - val_loss: 0.1787 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1280 - val_loss: 0.1776 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1253 - val_loss: 0.1778 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1258 - val_loss: 0.1764 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1259 - val_loss: 0.1767 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1772 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1242 - val_loss: 0.1771 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1238 - val_loss: 0.1756 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1234 - val_loss: 0.1753 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1250 - val_loss: 0.1755 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1757 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1244 - val_loss: 0.1756 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1240 - val_loss: 0.1752 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1243 - val_loss: 0.1752 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1214 - val_loss: 0.1753 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1209 - val_loss: 0.1752 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1239 - val_loss: 0.1751 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1226 - val_loss: 0.1750 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1223 - val_loss: 0.1750 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1231 - val_loss: 0.1750 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1221 - val_loss: 0.1750 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1221 - val_loss: 0.1750 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1750 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1217 - val_loss: 0.1750 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1225 - val_loss: 0.1750 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 12ms/step - loss: 0.1220 - val_loss: 0.1750 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1212 - val_loss: 0.1750 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1750 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1217 - val_loss: 0.1750 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1227 - val_loss: 0.1750 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1223 - val_loss: 0.1750 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1241 - val_loss: 0.1750 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1243 - val_loss: 0.1750 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1243 - val_loss: 0.1750 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1238 - val_loss: 0.1750 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1227 - val_loss: 0.1750 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1224 - val_loss: 0.1750 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1243 - val_loss: 0.1750 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1750 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1222 - val_loss: 0.1750 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1242 - val_loss: 0.1750 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1235 - val_loss: 0.1750 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1236 - val_loss: 0.1750 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1227 - val_loss: 0.1750 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1228 - val_loss: 0.1750 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1248 - val_loss: 0.1750 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1234 - val_loss: 0.1750 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1225 - val_loss: 0.1750 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1229 - val_loss: 0.1750 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1229 - val_loss: 0.1750 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1216 - val_loss: 0.1750 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1232 - val_loss: 0.1750 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1750 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1230 - val_loss: 0.1750 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1234 - val_loss: 0.1750 - lr: 2.2897e-14
Epoch 76/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1239 - val_loss: 0.1750 - lr: 1.1370e-14
Epoch 77/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1215 - val_loss: 0.1750 - lr: 5.6464e-15
Epoch 78/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1222 - val_loss: 0.1750 - lr: 2.8039e-15
Epoch 79/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1231 - val_loss: 0.1750 - lr: 1.3924e-15
Epoch 80/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1233 - val_loss: 0.1750 - lr: 6.9144e-16
Epoch 1/100

2023-11-27 18:37:42.611611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:42.612047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:42.612742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:42.665833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:42.666256: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:42.666603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:42.749897: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:42.750394: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:42.750875: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:42.810244: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:42.810719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:42.811138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:43.044312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:43.044849: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:43.045421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:43.103047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:43.103504: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:43.103930: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 38ms/step - loss: 0.2493 - val_loss: 0.1859 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.2195

2023-11-27 18:37:43.696064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:43.696534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:43.697202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:43.759200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:43.759567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:43.759954: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.2287 - val_loss: 0.1765 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2127 - val_loss: 0.1715 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.2005 - val_loss: 0.1608 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1883 - val_loss: 0.1600 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1776 - val_loss: 0.1633 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1694 - val_loss: 0.1607 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1606 - val_loss: 0.1595 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1522 - val_loss: 0.1600 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1468 - val_loss: 0.1504 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1399 - val_loss: 0.1480 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1342 - val_loss: 0.1499 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1306 - val_loss: 0.1414 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1258 - val_loss: 0.1422 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1235 - val_loss: 0.1397 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1202 - val_loss: 0.1347 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1171 - val_loss: 0.1337 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1163 - val_loss: 0.1314 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1156 - val_loss: 0.1281 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1120 - val_loss: 0.1292 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1107 - val_loss: 0.1245 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1105 - val_loss: 0.1237 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1087 - val_loss: 0.1219 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1070 - val_loss: 0.1262 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1058 - val_loss: 0.1221 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1060 - val_loss: 0.1201 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1054 - val_loss: 0.1209 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1055 - val_loss: 0.1201 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1039 - val_loss: 0.1192 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1027 - val_loss: 0.1186 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1041 - val_loss: 0.1193 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1050 - val_loss: 0.1203 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1033 - val_loss: 0.1198 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1033 - val_loss: 0.1195 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1036 - val_loss: 0.1192 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1039 - val_loss: 0.1189 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1035 - val_loss: 0.1189 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1030 - val_loss: 0.1190 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1033 - val_loss: 0.1190 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1190 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1038 - val_loss: 0.1191 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1032 - val_loss: 0.1191 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1037 - val_loss: 0.1191 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1034 - val_loss: 0.1191 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1039 - val_loss: 0.1191 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 10ms/step - loss: 0.1029 - val_loss: 0.1191 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1039 - val_loss: 0.1191 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1043 - val_loss: 0.1191 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1036 - val_loss: 0.1191 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1037 - val_loss: 0.1191 - lr: 4.5400e-08
Epoch 1/100

2023-11-27 18:37:47.549305: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:47.549746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:47.550324: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:47.607515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:47.607929: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:47.608277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:47.688989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:47.689485: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:47.689901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:47.749918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:47.750397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:47.750825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:47.984856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:47.985315: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:47.985882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:48.043528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:48.043989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:48.044418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 27ms/step - loss: 0.2377 - val_loss: 0.2186 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.2462

2023-11-27 18:37:48.657998: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:48.658430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:48.658829: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:48.720246: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:48.720678: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:48.721058: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.2134 - val_loss: 0.2140 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1902 - val_loss: 0.1886 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1822 - val_loss: 0.1673 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1742 - val_loss: 0.1619 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1606 - val_loss: 0.1550 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1492 - val_loss: 0.1368 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1392 - val_loss: 0.1262 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1342 - val_loss: 0.1204 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1293 - val_loss: 0.1185 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1268 - val_loss: 0.1182 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 9ms/step - loss: 0.1356 - val_loss: 0.1179 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1213 - val_loss: 0.1192 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1130 - val_loss: 0.1050 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1082 - val_loss: 0.1022 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1056 - val_loss: 0.1037 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1026 - val_loss: 0.1031 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1001 - val_loss: 0.1016 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0979 - val_loss: 0.0999 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0971 - val_loss: 0.0958 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0955 - val_loss: 0.0967 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0943 - val_loss: 0.0945 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0950 - val_loss: 0.0943 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0942 - val_loss: 0.0956 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0931 - val_loss: 0.0969 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0920 - val_loss: 0.0938 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0930 - val_loss: 0.0951 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0918 - val_loss: 0.0938 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0926 - val_loss: 0.0940 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0930 - val_loss: 0.0937 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0919 - val_loss: 0.0934 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0928 - val_loss: 0.0947 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0921 - val_loss: 0.0943 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0908 - val_loss: 0.0937 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0921 - val_loss: 0.0937 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0916 - val_loss: 0.0937 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0919 - val_loss: 0.0938 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0920 - val_loss: 0.0939 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0911 - val_loss: 0.0938 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0914 - val_loss: 0.0940 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0915 - val_loss: 0.0941 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0923 - val_loss: 0.0941 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0908 - val_loss: 0.0941 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0920 - val_loss: 0.0941 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0915 - val_loss: 0.0941 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0915 - val_loss: 0.0941 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0918 - val_loss: 0.0941 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0915 - val_loss: 0.0941 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0908 - val_loss: 0.0941 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0918 - val_loss: 0.0941 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0920 - val_loss: 0.0941 - lr: 2.7536e-08
Epoch 1/100

2023-11-27 18:37:54.000177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.000611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.001181: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:54.055200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.055525: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.055880: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:54.137185: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.137673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.138063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:54.197533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.197991: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.198419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:54.448742: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.449419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.449925: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:54.508637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:54.509081: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:54.509513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 22ms/step - loss: 0.2305 - val_loss: 0.2134 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.2342

2023-11-27 18:37:55.152229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:55.152889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:55.153387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:37:55.214031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:37:55.214449: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:37:55.214847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 7ms/step - loss: 0.2075 - val_loss: 0.1988 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1916 - val_loss: 0.1876 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1763 - val_loss: 0.1987 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1736 - val_loss: 0.2031 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1697 - val_loss: 0.1587 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1498 - val_loss: 0.1595 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1441 - val_loss: 0.1821 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1494 - val_loss: 0.1580 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1397 - val_loss: 0.1339 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1247 - val_loss: 0.1503 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1290 - val_loss: 0.1558 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1303 - val_loss: 0.1275 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1166 - val_loss: 0.1246 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1120 - val_loss: 0.1278 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1110 - val_loss: 0.1255 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1113 - val_loss: 0.1173 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1061 - val_loss: 0.1145 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1038 - val_loss: 0.1121 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1013 - val_loss: 0.1109 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 7ms/step - loss: 0.1003 - val_loss: 0.1037 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0970 - val_loss: 0.0999 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0944 - val_loss: 0.0982 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0936 - val_loss: 0.0969 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0934 - val_loss: 0.0944 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0927 - val_loss: 0.0932 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0909 - val_loss: 0.0926 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0901 - val_loss: 0.0917 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0907 - val_loss: 0.0902 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0907 - val_loss: 0.0911 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0911 - val_loss: 0.0902 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0894 - val_loss: 0.0901 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0902 - val_loss: 0.0896 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0887 - val_loss: 0.0895 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0900 - val_loss: 0.0894 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0899 - val_loss: 0.0893 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0883 - val_loss: 0.0892 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0886 - val_loss: 0.0892 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0884 - val_loss: 0.0891 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0887 - val_loss: 0.0891 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0898 - val_loss: 0.0891 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0884 - val_loss: 0.0891 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0895 - val_loss: 0.0891 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0898 - val_loss: 0.0891 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0894 - val_loss: 0.0891 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0894 - val_loss: 0.0891 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0892 - val_loss: 0.0891 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0896 - val_loss: 0.0891 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0893 - val_loss: 0.0891 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0883 - val_loss: 0.0891 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0890 - val_loss: 0.0891 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0890 - val_loss: 0.0891 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0895 - val_loss: 0.0891 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0897 - val_loss: 0.0891 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0900 - val_loss: 0.0891 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0894 - val_loss: 0.0891 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0892 - val_loss: 0.0891 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0894 - val_loss: 0.0891 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0889 - val_loss: 0.0891 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0889 - val_loss: 0.0891 - lr: 3.0590e-10
Epoch 1/100

2023-11-27 18:38:02.993581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:02.993948: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:02.994310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:03.047337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:03.047723: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:03.048061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:03.128795: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:03.129301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:03.129737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:03.188918: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:03.189404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:03.189823: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:03.429572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:03.430224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:03.430761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:03.490347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:03.490825: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:03.491247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 18ms/step - loss: 0.2274 - val_loss: 0.2040 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.2172

2023-11-27 18:38:04.181383: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:04.181851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:04.182385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:04.244078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:04.244595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:04.244964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.1995 - val_loss: 0.1874 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1802 - val_loss: 0.1734 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1670 - val_loss: 0.1638 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1576 - val_loss: 0.1573 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1473 - val_loss: 0.1466 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1384 - val_loss: 0.1389 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1306 - val_loss: 0.1296 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1220 - val_loss: 0.1216 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1170 - val_loss: 0.1162 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1123 - val_loss: 0.1169 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1096 - val_loss: 0.1154 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1086 - val_loss: 0.1217 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1093 - val_loss: 0.1149 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1023 - val_loss: 0.1064 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0960 - val_loss: 0.1040 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0931 - val_loss: 0.1012 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0914 - val_loss: 0.0985 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0874 - val_loss: 0.0933 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0827 - val_loss: 0.0860 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0786 - val_loss: 0.0834 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0806 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0761 - val_loss: 0.0774 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0749 - val_loss: 0.0745 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0736 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0729 - val_loss: 0.0730 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0725 - val_loss: 0.0725 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0721 - val_loss: 0.0721 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0719 - val_loss: 0.0721 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0711 - val_loss: 0.0719 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0715 - val_loss: 0.0719 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0717 - val_loss: 0.0718 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0711 - val_loss: 0.0717 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0703 - val_loss: 0.0717 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0712 - val_loss: 0.0716 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0710 - val_loss: 0.0715 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0707 - val_loss: 0.0715 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0712 - val_loss: 0.0715 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0707 - val_loss: 0.0715 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0705 - val_loss: 0.0715 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0709 - val_loss: 0.0715 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0718 - val_loss: 0.0715 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0712 - val_loss: 0.0715 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0708 - val_loss: 0.0715 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0705 - val_loss: 0.0715 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0712 - val_loss: 0.0715 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0711 - val_loss: 0.0715 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0707 - val_loss: 0.0715 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0706 - val_loss: 0.0715 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0706 - val_loss: 0.0715 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0707 - val_loss: 0.0715 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0705 - val_loss: 0.0715 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0709 - val_loss: 0.0715 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0707 - val_loss: 0.0715 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0708 - val_loss: 0.0715 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0713 - val_loss: 0.0715 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0705 - val_loss: 0.0715 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0708 - val_loss: 0.0715 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0708 - val_loss: 0.0715 - lr: 5.0435e-10
Average Validation Loss: 0.10950190871953965
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100

2023-11-27 18:38:13.773595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:13.774043: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:13.774521: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:13.835459: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:13.836045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:13.836548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:13.922791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:13.923281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:13.923709: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:13.984436: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:13.985017: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:13.985661: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:14.219915: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:14.220386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:14.220908: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:14.278658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:14.279097: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:14.279507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 2s 19ms/step - loss: 0.1220 - val_loss: 0.1664 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1343

2023-11-27 18:38:15.426826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:15.427331: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:15.428034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:15.489847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:15.490359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:15.490847: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.1377 - val_loss: 0.1326 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1211 - val_loss: 0.1282 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1087 - val_loss: 0.1347 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1147 - val_loss: 0.1229 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0977 - val_loss: 0.1338 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1004 - val_loss: 0.1280 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0942 - val_loss: 0.1149 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0751 - val_loss: 0.1180 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0669 - val_loss: 0.1037 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.1027 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.1041 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0704 - val_loss: 0.0895 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.1039 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0626 - val_loss: 0.1032 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0905 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0894 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0540 - val_loss: 0.0968 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0906 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0898 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0890 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0441 - val_loss: 0.0884 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0933 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0451 - val_loss: 0.0872 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0900 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0439 - val_loss: 0.0877 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0452 - val_loss: 0.0890 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0879 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0908 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0451 - val_loss: 0.0880 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0890 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0872 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0865 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0874 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0882 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0885 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0881 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0878 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0880 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0881 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0421 - val_loss: 0.0880 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0879 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0878 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0878 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0878 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0446 - val_loss: 0.0878 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0878 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0444 - val_loss: 0.0879 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0879 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0879 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0879 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0879 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0879 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:38:19.975301: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:19.975708: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:19.976319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.032100: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.032460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.032809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.111307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.111788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.112207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.171146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.171618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.172052: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.351797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.352245: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.352731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.408961: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.409404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.409828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 11ms/step - loss: 0.1436 - val_loss: 0.1119 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0645

2023-11-27 18:38:20.919584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.920067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.920609: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:20.980809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:20.981253: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:20.981643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1355 - val_loss: 0.0775 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1277 - val_loss: 0.0828 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1257 - val_loss: 0.0719 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1216 - val_loss: 0.0755 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1184 - val_loss: 0.0659 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1131 - val_loss: 0.0848 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1105 - val_loss: 0.0632 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1056 - val_loss: 0.1002 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0964 - val_loss: 0.0765 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1018 - val_loss: 0.0649 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0991 - val_loss: 0.0801 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0874 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0868 - val_loss: 0.0735 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0802 - val_loss: 0.0730 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0721 - val_loss: 0.0745 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0692 - val_loss: 0.0689 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0673 - val_loss: 0.0653 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0667 - val_loss: 0.0619 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0622 - val_loss: 0.0622 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0637 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0565 - val_loss: 0.0616 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0557 - val_loss: 0.0618 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0538 - val_loss: 0.0638 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0522 - val_loss: 0.0636 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0635 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0503 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0491 - val_loss: 0.0635 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0642 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0488 - val_loss: 0.0648 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0475 - val_loss: 0.0641 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0471 - val_loss: 0.0642 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0644 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0653 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0484 - val_loss: 0.0643 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0644 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0478 - val_loss: 0.0642 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0642 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0473 - val_loss: 0.0642 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0486 - val_loss: 0.0643 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0477 - val_loss: 0.0643 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0483 - val_loss: 0.0643 - lr: 1.1138e-06
Epoch 1/100

2023-11-27 18:38:25.695106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:25.695535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:25.696127: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:25.752794: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:25.753189: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:25.753524: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:25.838924: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:25.839581: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:25.840084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:25.903327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:25.903846: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:25.904533: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:26.153714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:26.154247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:26.154683: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:26.212470: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:26.212932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:26.213338: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1288 - val_loss: 0.1080 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1015

2023-11-27 18:38:26.946651: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:26.947105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:26.947608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:27.007717: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:27.008156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:27.008539: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1154 - val_loss: 0.0973 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1103 - val_loss: 0.0940 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1055 - val_loss: 0.0896 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1007 - val_loss: 0.0839 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0980 - val_loss: 0.0820 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1012 - val_loss: 0.0886 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0950 - val_loss: 0.0813 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0909 - val_loss: 0.0836 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0861 - val_loss: 0.0727 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0873 - val_loss: 0.0755 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0742 - val_loss: 0.0620 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0724 - val_loss: 0.0656 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0684 - val_loss: 0.0589 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0633 - val_loss: 0.0604 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0595 - val_loss: 0.0551 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0553 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0559 - val_loss: 0.0528 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0522 - val_loss: 0.0527 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0515 - val_loss: 0.0525 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0520 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0532 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0522 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0508 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0493 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0478 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0468 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0466 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0466 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0463 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0466 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0465 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0439 - val_loss: 0.0465 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0467 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0456 - val_loss: 0.0469 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0468 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0469 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0469 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0469 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0469 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0469 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0442 - val_loss: 0.0469 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0469 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0440 - val_loss: 0.0469 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0441 - val_loss: 0.0469 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0469 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0469 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0449 - val_loss: 0.0469 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0469 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0448 - val_loss: 0.0469 - lr: 2.7536e-08
Epoch 1/100

2023-11-27 18:38:36.981122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:36.981527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:36.982034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:37.035250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:37.035659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:37.036024: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:37.115755: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:37.116262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:37.116673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:37.176297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:37.176732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:37.177154: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:37.409906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:37.410558: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:37.410995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:37.470577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:37.471065: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:37.471477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.1264 - val_loss: 0.1306 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1452

2023-11-27 18:38:38.293655: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:38.294136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:38.294802: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:38.355535: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:38.355966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:38.356355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1167 - val_loss: 0.1148 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1112 - val_loss: 0.1077 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1066 - val_loss: 0.1101 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1005 - val_loss: 0.1014 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0961 - val_loss: 0.0935 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0889 - val_loss: 0.0893 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0834 - val_loss: 0.0911 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0773 - val_loss: 0.0947 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0737 - val_loss: 0.1038 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1022 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.0956 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0640 - val_loss: 0.0890 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0626 - val_loss: 0.0806 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0605 - val_loss: 0.0756 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0719 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0724 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0757 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0536 - val_loss: 0.0759 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0549 - val_loss: 0.0731 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0789 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0525 - val_loss: 0.0793 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0530 - val_loss: 0.0799 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0805 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 3ms/step - loss: 0.0552 - val_loss: 0.0757 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0554 - val_loss: 0.0717 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0545 - val_loss: 0.0660 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0521 - val_loss: 0.0640 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0625 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0606 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0490 - val_loss: 0.0599 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0488 - val_loss: 0.0591 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0588 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0586 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0585 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0584 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0583 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0583 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0582 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0582 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0582 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0582 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0582 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0582 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0582 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0479 - val_loss: 0.0582 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0582 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0582 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0582 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0582 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0482 - val_loss: 0.0582 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0582 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0582 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0582 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0582 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0474 - val_loss: 0.0582 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0582 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0582 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0467 - val_loss: 0.0582 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0467 - val_loss: 0.0582 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0582 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0475 - val_loss: 0.0582 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0477 - val_loss: 0.0582 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0582 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0582 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0582 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0478 - val_loss: 0.0582 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0473 - val_loss: 0.0582 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0582 - lr: 1.3924e-15
Epoch 1/100

2023-11-27 18:38:58.005310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.005776: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.006223: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:58.060887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.061291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.061659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:58.141385: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.141872: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.142299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:58.202396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.202856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.203271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:58.434933: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.435408: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.435850: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:58.493527: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:58.493972: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:58.494387: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 7ms/step - loss: 0.1332 - val_loss: 0.1119 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0612

2023-11-27 18:38:59.344922: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:59.345386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:59.346039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:38:59.406230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:38:59.406676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:38:59.407068: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1163 - val_loss: 0.1067 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1099 - val_loss: 0.1025 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.1023 - val_loss: 0.1000 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0950 - val_loss: 0.0947 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0884 - val_loss: 0.0924 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0841 - val_loss: 0.0880 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0794 - val_loss: 0.0852 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0752 - val_loss: 0.0847 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0724 - val_loss: 0.0788 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0778 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0628 - val_loss: 0.0736 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0595 - val_loss: 0.0697 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0686 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0543 - val_loss: 0.0675 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0525 - val_loss: 0.0652 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0501 - val_loss: 0.0648 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0507 - val_loss: 0.0628 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0471 - val_loss: 0.0598 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0583 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0451 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0557 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0418 - val_loss: 0.0544 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0406 - val_loss: 0.0540 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0407 - val_loss: 0.0539 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0390 - val_loss: 0.0525 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0386 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0521 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0389 - val_loss: 0.0515 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0514 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0509 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0506 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0381 - val_loss: 0.0505 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0503 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0502 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0501 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0501 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0501 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0500 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0500 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0500 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0372 - val_loss: 0.0500 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0500 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0500 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0500 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0500 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0500 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0500 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0382 - val_loss: 0.0500 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0500 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0368 - val_loss: 0.0500 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0372 - val_loss: 0.0500 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0368 - val_loss: 0.0500 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0500 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0500 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0500 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0378 - val_loss: 0.0500 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0370 - val_loss: 0.0500 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0382 - val_loss: 0.0500 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0376 - val_loss: 0.0500 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0500 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0366 - val_loss: 0.0500 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0500 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0500 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0370 - val_loss: 0.0500 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0367 - val_loss: 0.0500 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0374 - val_loss: 0.0500 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0500 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0500 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0371 - val_loss: 0.0500 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0365 - val_loss: 0.0500 - lr: 6.9144e-16
Average Validation Loss: 0.06051771193742752
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100

2023-11-27 18:39:23.376534: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.376958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.377549: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:23.431773: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.432170: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.432529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:23.514588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.515089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.515507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:23.574782: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.575236: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.575659: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:23.811605: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.812321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.813119: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:23.879787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:23.880220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:23.880645: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 37ms/step - loss: 0.1726 - val_loss: 0.1469 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0709

2023-11-27 18:39:24.478263: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:24.478758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:24.479450: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:24.540529: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:24.540943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:24.541336: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.1246 - val_loss: 0.1629 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1260 - val_loss: 0.1430 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1190 - val_loss: 0.1289 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1099 - val_loss: 0.1301 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1020 - val_loss: 0.1322 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1015 - val_loss: 0.1241 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0907 - val_loss: 0.1191 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.1130 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0724 - val_loss: 0.1058 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0706 - val_loss: 0.1108 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0598 - val_loss: 0.1232 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0590 - val_loss: 0.1122 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0574 - val_loss: 0.1159 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0567 - val_loss: 0.1081 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0578 - val_loss: 0.1150 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0559 - val_loss: 0.1137 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0557 - val_loss: 0.1208 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0558 - val_loss: 0.1073 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0526 - val_loss: 0.1233 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0551 - val_loss: 0.1048 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0531 - val_loss: 0.1168 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0549 - val_loss: 0.1100 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0519 - val_loss: 0.1074 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0524 - val_loss: 0.1141 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0535 - val_loss: 0.1114 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0506 - val_loss: 0.1082 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0512 - val_loss: 0.1095 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0525 - val_loss: 0.1110 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0526 - val_loss: 0.1099 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0507 - val_loss: 0.1085 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0494 - val_loss: 0.1083 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0522 - val_loss: 0.1090 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0498 - val_loss: 0.1099 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0531 - val_loss: 0.1103 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0514 - val_loss: 0.1104 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0534 - val_loss: 0.1104 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0534 - val_loss: 0.1104 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0498 - val_loss: 0.1104 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0528 - val_loss: 0.1103 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0500 - val_loss: 0.1103 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:39:27.020451: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.020889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.021395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:27.077291: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.077676: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.078019: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:27.158707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.159294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.159808: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:27.218571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.218963: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.219379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:27.402727: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.403187: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.403637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:27.460406: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.460884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.461308: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1625 - val_loss: 0.0976 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1185

2023-11-27 18:39:27.957687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:27.958593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:27.959057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:28.021818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:28.022255: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:28.022637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1389 - val_loss: 0.0945 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1255 - val_loss: 0.0815 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1221 - val_loss: 0.0833 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1159 - val_loss: 0.0824 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1103 - val_loss: 0.0879 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1060 - val_loss: 0.0791 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1031 - val_loss: 0.0842 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.1010 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0916 - val_loss: 0.0904 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0915 - val_loss: 0.0755 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0804 - val_loss: 0.0766 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0761 - val_loss: 0.0731 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0721 - val_loss: 0.0724 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0671 - val_loss: 0.0721 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0809 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0650 - val_loss: 0.0735 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0637 - val_loss: 0.0596 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0611 - val_loss: 0.0595 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0654 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0556 - val_loss: 0.0695 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0614 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0611 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0540 - val_loss: 0.0621 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0614 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0614 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0612 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0610 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0512 - val_loss: 0.0610 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0603 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0521 - val_loss: 0.0601 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0514 - val_loss: 0.0602 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0604 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0605 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0520 - val_loss: 0.0605 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0529 - val_loss: 0.0603 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0605 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0606 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0605 - lr: 3.3460e-06
Epoch 1/100

2023-11-27 18:39:31.168589: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.169064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.169590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:31.224602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.225014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.225379: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:31.310766: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.311321: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.311760: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:31.374884: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.375433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.375996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:31.611958: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.612647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.613090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:31.671357: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:31.671811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:31.672254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 14ms/step - loss: 0.1254 - val_loss: 0.1239 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0722

2023-11-27 18:39:32.342784: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:32.343251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:32.343939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:32.404937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:32.405386: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:32.405774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.1131 - val_loss: 0.1085 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1090 - val_loss: 0.1031 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1048 - val_loss: 0.0984 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1006 - val_loss: 0.0915 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.1003 - val_loss: 0.0888 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0952 - val_loss: 0.0854 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0910 - val_loss: 0.0807 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0882 - val_loss: 0.0802 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0840 - val_loss: 0.0760 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0793 - val_loss: 0.0737 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0744 - val_loss: 0.0688 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0715 - val_loss: 0.0688 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0737 - val_loss: 0.0697 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0649 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0739 - val_loss: 0.0611 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0668 - val_loss: 0.0605 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0609 - val_loss: 0.0590 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0554 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0558 - val_loss: 0.0526 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0521 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0547 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0557 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0541 - val_loss: 0.0599 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0591 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0560 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0517 - val_loss: 0.0589 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0563 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0571 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0570 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0568 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0571 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0563 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0569 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0569 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0570 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0570 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0568 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0567 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0567 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0568 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:39:37.794220: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:37.794642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:37.795238: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:37.850951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:37.851351: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:37.851707: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:37.931110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:37.931586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:37.932061: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:37.992212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:37.992698: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:37.993130: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:38.226889: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:38.227354: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:38.227830: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:38.286530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:38.286985: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:38.287418: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 2s 12ms/step - loss: 0.1343 - val_loss: 0.1118 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0777

2023-11-27 18:39:39.505631: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:39.506101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:39.506737: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:39.567117: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:39.567542: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:39.567927: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1100 - val_loss: 0.1196 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.1059 - val_loss: 0.1083 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.1097 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0929 - val_loss: 0.0900 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0858 - val_loss: 0.0842 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0794 - val_loss: 0.0791 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0749 - val_loss: 0.0740 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0705 - val_loss: 0.0732 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0735 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0734 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.0686 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0608 - val_loss: 0.0662 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0718 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0605 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0756 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0606 - val_loss: 0.0742 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0600 - val_loss: 0.0772 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0786 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0617 - val_loss: 0.0847 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0653 - val_loss: 0.0838 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0692 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0621 - val_loss: 0.0630 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0600 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0571 - val_loss: 0.0584 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0561 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0551 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0546 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0542 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0535 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0534 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0533 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0531 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0530 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0530 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0530 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0530 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0530 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0529 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0529 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0529 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0529 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0529 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0529 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0529 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0529 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0529 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0529 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0529 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0529 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0529 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0529 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0529 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0529 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0529 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0529 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0529 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0529 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0529 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0529 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0529 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0529 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0529 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0529 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0529 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0529 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0529 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0529 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0529 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0529 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0510 - val_loss: 0.0529 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0498 - val_loss: 0.0529 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0529 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0501 - val_loss: 0.0529 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0529 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0529 - lr: 5.6464e-15
Epoch 1/100

2023-11-27 18:39:52.233225: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.233643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.234204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:52.287811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.288182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.288445: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:52.370827: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.371510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.372287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:52.442217: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.442765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.443288: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:52.676968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.677447: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.678047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:52.735530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:52.736002: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:52.736422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 10ms/step - loss: 0.1260 - val_loss: 0.1103 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0599

2023-11-27 18:39:53.472600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:53.473067: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:53.473701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:39:53.533675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:39:53.534110: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:39:53.534491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.1065 - val_loss: 0.1013 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0985 - val_loss: 0.0971 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0928 - val_loss: 0.0949 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0852 - val_loss: 0.0921 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0899 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0799 - val_loss: 0.0867 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0732 - val_loss: 0.0853 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0709 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0677 - val_loss: 0.0816 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0650 - val_loss: 0.0799 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0807 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0786 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0614 - val_loss: 0.0765 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0728 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0560 - val_loss: 0.0709 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0530 - val_loss: 0.0677 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0516 - val_loss: 0.0649 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0618 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0618 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0598 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0582 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0590 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0588 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0445 - val_loss: 0.0577 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0449 - val_loss: 0.0573 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0443 - val_loss: 0.0567 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.0564 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0562 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0442 - val_loss: 0.0555 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0553 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0551 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0550 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0437 - val_loss: 0.0550 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0436 - val_loss: 0.0550 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0434 - val_loss: 0.0549 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0549 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0549 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0435 - val_loss: 0.0549 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0549 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0549 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0549 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0549 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0549 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0549 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0549 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0432 - val_loss: 0.0549 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0426 - val_loss: 0.0549 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0433 - val_loss: 0.0549 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0418 - val_loss: 0.0549 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0549 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0549 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0549 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0424 - val_loss: 0.0549 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0429 - val_loss: 0.0549 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0549 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0549 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0549 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0430 - val_loss: 0.0549 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0549 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0549 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0428 - val_loss: 0.0549 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.0549 - lr: 5.0565e-11
Average Validation Loss: 0.06486509814858436
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100

2023-11-27 18:40:06.226031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.226466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.227064: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:06.282761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.283157: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.283532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:06.369602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.370045: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.370548: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:06.435484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.436221: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.436632: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:06.677731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.678282: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.678716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:06.737156: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:06.737619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:06.738032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 66ms/step - loss: 0.1529 - val_loss: 0.1524 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.1357

2023-11-27 18:40:07.311983: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:07.312415: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:07.312826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:07.374250: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:07.374689: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:07.375077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.1321 - val_loss: 0.1699 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1391 - val_loss: 0.1655 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1333 - val_loss: 0.1487 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1199 - val_loss: 0.1335 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1087 - val_loss: 0.1250 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 10ms/step - loss: 0.1012 - val_loss: 0.1259 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0987 - val_loss: 0.1306 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0949 - val_loss: 0.1224 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0874 - val_loss: 0.1078 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0765 - val_loss: 0.1090 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0713 - val_loss: 0.1113 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0671 - val_loss: 0.1036 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0638 - val_loss: 0.1167 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0648 - val_loss: 0.1038 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0606 - val_loss: 0.1091 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0597 - val_loss: 0.1044 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0589 - val_loss: 0.1032 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0583 - val_loss: 0.1087 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0575 - val_loss: 0.1047 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0564 - val_loss: 0.0999 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0576 - val_loss: 0.1026 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0567 - val_loss: 0.1069 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0566 - val_loss: 0.1075 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0551 - val_loss: 0.1033 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0552 - val_loss: 0.1013 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0548 - val_loss: 0.1017 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0566 - val_loss: 0.1016 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0557 - val_loss: 0.1031 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0553 - val_loss: 0.1035 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0552 - val_loss: 0.1037 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0562 - val_loss: 0.1035 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0552 - val_loss: 0.1032 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0554 - val_loss: 0.1029 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0538 - val_loss: 0.1027 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0564 - val_loss: 0.1026 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0545 - val_loss: 0.1026 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0557 - val_loss: 0.1026 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0549 - val_loss: 0.1027 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0564 - val_loss: 0.1028 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0548 - val_loss: 0.1028 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:40:09.502887: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:09.503322: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:09.503926: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:09.557775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:09.558214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:09.558562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:09.644856: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:09.645335: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:09.645775: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:09.707008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:09.707505: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:09.707936: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:09.945917: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:09.946512: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:09.947020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:10.005619: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:10.006089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:10.006507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1645 - val_loss: 0.1011 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1215

2023-11-27 18:40:10.601214: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:10.601758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:10.602343: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:10.663797: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:10.664224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:10.664597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 8ms/step - loss: 0.1388 - val_loss: 0.0943 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1254 - val_loss: 0.0984 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1165 - val_loss: 0.0825 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1099 - val_loss: 0.0870 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1023 - val_loss: 0.0814 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0963 - val_loss: 0.0795 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0904 - val_loss: 0.0805 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0881 - val_loss: 0.0808 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0837 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0787 - val_loss: 0.0733 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0744 - val_loss: 0.0749 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0737 - val_loss: 0.0797 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0732 - val_loss: 0.0676 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0690 - val_loss: 0.0673 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0659 - val_loss: 0.0765 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0676 - val_loss: 0.0746 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0668 - val_loss: 0.0666 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0635 - val_loss: 0.0713 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0641 - val_loss: 0.0658 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0616 - val_loss: 0.0687 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0606 - val_loss: 0.0664 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0604 - val_loss: 0.0682 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0605 - val_loss: 0.0704 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0609 - val_loss: 0.0667 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0601 - val_loss: 0.0691 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0582 - val_loss: 0.0660 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0587 - val_loss: 0.0638 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0586 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0588 - val_loss: 0.0670 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0587 - val_loss: 0.0651 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0576 - val_loss: 0.0639 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0572 - val_loss: 0.0642 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0590 - val_loss: 0.0649 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0591 - val_loss: 0.0653 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0580 - val_loss: 0.0651 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0579 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0577 - val_loss: 0.0655 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0578 - val_loss: 0.0656 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0577 - val_loss: 0.0657 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0578 - val_loss: 0.0657 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0592 - val_loss: 0.0657 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0592 - val_loss: 0.0657 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0583 - val_loss: 0.0657 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0576 - val_loss: 0.0657 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0574 - val_loss: 0.0657 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0587 - val_loss: 0.0657 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0584 - val_loss: 0.0657 - lr: 1.0104e-07
Epoch 1/100

2023-11-27 18:40:14.336900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.337577: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.337900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:14.397637: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.397990: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.398327: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:14.481621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.482122: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.482540: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:14.543584: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.544103: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.544519: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:14.780063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.780682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.781138: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:14.847747: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:14.848210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:14.848593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 27ms/step - loss: 0.1376 - val_loss: 0.1237 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1470

2023-11-27 18:40:15.463146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:15.463815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:15.464307: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:15.525664: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:15.526126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:15.526520: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 7ms/step - loss: 0.1186 - val_loss: 0.1265 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.1068 - val_loss: 0.1093 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 7ms/step - loss: 0.1040 - val_loss: 0.1037 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0969 - val_loss: 0.0950 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0937 - val_loss: 0.0850 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0922 - val_loss: 0.0815 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0873 - val_loss: 0.0787 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0833 - val_loss: 0.0739 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0813 - val_loss: 0.0731 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0825 - val_loss: 0.0709 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0793 - val_loss: 0.0726 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0782 - val_loss: 0.0745 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0720 - val_loss: 0.0683 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0685 - val_loss: 0.0628 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0686 - val_loss: 0.0613 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0694 - val_loss: 0.0650 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0695 - val_loss: 0.0757 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0653 - val_loss: 0.0701 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0617 - val_loss: 0.0608 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0612 - val_loss: 0.0612 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0607 - val_loss: 0.0612 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0584 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0576 - val_loss: 0.0601 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0574 - val_loss: 0.0592 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0573 - val_loss: 0.0570 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0581 - val_loss: 0.0580 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0559 - val_loss: 0.0577 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 7ms/step - loss: 0.0570 - val_loss: 0.0567 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0563 - val_loss: 0.0561 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0559 - val_loss: 0.0555 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0561 - val_loss: 0.0559 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0558 - val_loss: 0.0562 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0551 - val_loss: 0.0560 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0557 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0554 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0565 - val_loss: 0.0552 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0561 - val_loss: 0.0552 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0569 - val_loss: 0.0553 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0554 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0557 - val_loss: 0.0555 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0555 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0546 - val_loss: 0.0555 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0558 - val_loss: 0.0555 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0550 - val_loss: 0.0555 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0556 - val_loss: 0.0555 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0555 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0549 - val_loss: 0.0555 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0560 - val_loss: 0.0555 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0548 - val_loss: 0.0555 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0555 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0555 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0555 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0555 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0549 - val_loss: 0.0555 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0555 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0564 - val_loss: 0.0555 - lr: 1.3710e-09
Epoch 1/100

2023-11-27 18:40:21.417484: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.418266: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.418739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:21.474681: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.475051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.475337: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:21.558460: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.559325: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.560049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:21.629883: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.630503: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.631060: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:21.880177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.880892: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.881299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:21.941066: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:21.941532: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:21.941976: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 22ms/step - loss: 0.1406 - val_loss: 0.1232 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1417

2023-11-27 18:40:22.584786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:22.585211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:22.585610: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:22.646791: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:22.647251: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:22.647641: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 8ms/step - loss: 0.1204 - val_loss: 0.1218 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 9ms/step - loss: 0.1125 - val_loss: 0.1181 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1070 - val_loss: 0.1204 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1051 - val_loss: 0.1194 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.1013 - val_loss: 0.1131 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0975 - val_loss: 0.1054 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0930 - val_loss: 0.1068 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0899 - val_loss: 0.1073 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0850 - val_loss: 0.1096 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0834 - val_loss: 0.1100 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0848 - val_loss: 0.0907 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0798 - val_loss: 0.0830 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0745 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0704 - val_loss: 0.0804 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0681 - val_loss: 0.0771 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0681 - val_loss: 0.0740 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0649 - val_loss: 0.0722 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0642 - val_loss: 0.0685 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0637 - val_loss: 0.0637 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0634 - val_loss: 0.0543 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0603 - val_loss: 0.0495 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0579 - val_loss: 0.0499 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0573 - val_loss: 0.0509 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0561 - val_loss: 0.0500 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0570 - val_loss: 0.0489 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0566 - val_loss: 0.0478 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0487 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0561 - val_loss: 0.0487 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0561 - val_loss: 0.0474 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0552 - val_loss: 0.0475 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0553 - val_loss: 0.0476 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0551 - val_loss: 0.0476 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0550 - val_loss: 0.0475 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0552 - val_loss: 0.0473 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0545 - val_loss: 0.0475 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0554 - val_loss: 0.0475 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0548 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0556 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0547 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0539 - val_loss: 0.0476 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0546 - val_loss: 0.0476 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0476 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0555 - val_loss: 0.0476 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0546 - val_loss: 0.0476 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0543 - val_loss: 0.0476 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0548 - val_loss: 0.0476 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0543 - val_loss: 0.0476 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0476 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0548 - val_loss: 0.0476 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0541 - val_loss: 0.0476 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0549 - val_loss: 0.0476 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0476 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0550 - val_loss: 0.0476 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0548 - val_loss: 0.0476 - lr: 3.7267e-09
Epoch 1/100

2023-11-27 18:40:29.837284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:29.837744: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:29.838203: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:29.892224: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:29.892713: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:29.893108: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:29.975395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:29.975863: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:29.976352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:30.037499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:30.037901: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:30.038316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:30.274837: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:30.275312: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:30.276004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:30.336695: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:30.337183: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:30.337623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 17ms/step - loss: 0.1550 - val_loss: 0.1198 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1435

2023-11-27 18:40:31.030934: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:31.031601: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:31.032029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:31.092919: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:31.093448: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:31.093904: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.1236 - val_loss: 0.1159 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1127 - val_loss: 0.1120 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1097 - val_loss: 0.1128 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1066 - val_loss: 0.1098 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0997 - val_loss: 0.1054 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0972 - val_loss: 0.1054 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0969 - val_loss: 0.1072 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0953 - val_loss: 0.1032 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0894 - val_loss: 0.1030 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0853 - val_loss: 0.1014 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0832 - val_loss: 0.1009 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0808 - val_loss: 0.0972 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0770 - val_loss: 0.0971 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0741 - val_loss: 0.0937 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0685 - val_loss: 0.0900 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0650 - val_loss: 0.0885 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0647 - val_loss: 0.0879 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0630 - val_loss: 0.0843 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0617 - val_loss: 0.0820 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0581 - val_loss: 0.0795 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0570 - val_loss: 0.0785 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0556 - val_loss: 0.0774 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0545 - val_loss: 0.0776 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0542 - val_loss: 0.0766 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0543 - val_loss: 0.0762 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0532 - val_loss: 0.0757 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0541 - val_loss: 0.0756 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0537 - val_loss: 0.0757 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0541 - val_loss: 0.0754 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0520 - val_loss: 0.0752 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0525 - val_loss: 0.0751 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0526 - val_loss: 0.0750 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0750 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0534 - val_loss: 0.0751 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0523 - val_loss: 0.0751 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0528 - val_loss: 0.0751 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0530 - val_loss: 0.0751 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0521 - val_loss: 0.0750 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0520 - val_loss: 0.0750 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0522 - val_loss: 0.0750 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0524 - val_loss: 0.0750 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0521 - val_loss: 0.0750 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0524 - val_loss: 0.0750 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0530 - val_loss: 0.0750 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0533 - val_loss: 0.0750 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0524 - val_loss: 0.0750 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0520 - val_loss: 0.0750 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0529 - val_loss: 0.0750 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0530 - val_loss: 0.0750 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0519 - val_loss: 0.0750 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0528 - val_loss: 0.0750 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0526 - val_loss: 0.0750 - lr: 1.0130e-08
Average Validation Loss: 0.06823576763272285
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100

2023-11-27 18:40:39.580478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:39.581102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:39.581598: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:39.635229: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:39.635582: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:39.635932: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:39.718774: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:39.719271: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:39.719780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:39.780479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:39.780939: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:39.781397: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:40.023740: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:40.024342: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:40.024835: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:40.083013: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:40.083465: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:40.083903: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 1s 20ms/step - loss: 0.1012 - val_loss: 0.1748 - lr: 0.0010
Epoch 2/100
 1/18 [>.............................] - ETA: 0s - loss: 0.1631

2023-11-27 18:40:40.699259: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:40.699804: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:40.700513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:40.770192: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:40.770666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:40.771063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

18/18 [==============================] - 0s 5ms/step - loss: 0.1301 - val_loss: 0.1181 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1038 - val_loss: 0.1187 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.1238 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0969 - val_loss: 0.1135 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0713 - val_loss: 0.1329 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0745 - val_loss: 0.1608 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 5ms/step - loss: 0.1004 - val_loss: 0.1035 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.1029 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0691 - val_loss: 0.1108 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.1107 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0604 - val_loss: 0.1161 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.1064 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0944 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.1151 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.1115 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0995 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0448 - val_loss: 0.1010 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.1119 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0885 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.1060 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0427 - val_loss: 0.1014 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0965 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0422 - val_loss: 0.0990 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.1054 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0975 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.1000 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.1002 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.1000 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.1008 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0418 - val_loss: 0.0977 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0988 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0982 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0986 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0981 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0410 - val_loss: 0.0982 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0406 - val_loss: 0.0976 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0974 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0421 - val_loss: 0.0977 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 5ms/step - loss: 0.0423 - val_loss: 0.0975 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:40:44.231422: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:44.231969: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:44.232318: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:44.287469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:44.287877: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:44.288227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:44.371208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:44.371729: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:44.372202: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:44.434077: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:44.434685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:44.435272: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:44.625982: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:44.626441: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:44.626871: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:45.250995: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:45.251463: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:45.252144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 2s 11ms/step - loss: 0.1327 - val_loss: 0.1063 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0478

2023-11-27 18:40:45.768046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:45.768894: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:45.769359: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:45.840595: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:45.841046: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:45.841490: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 3ms/step - loss: 0.1304 - val_loss: 0.0738 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1226 - val_loss: 0.0763 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1178 - val_loss: 0.0728 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1154 - val_loss: 0.0662 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1120 - val_loss: 0.0730 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1102 - val_loss: 0.0623 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1062 - val_loss: 0.0768 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 3ms/step - loss: 0.1028 - val_loss: 0.0608 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0993 - val_loss: 0.0879 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0925 - val_loss: 0.0599 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0948 - val_loss: 0.0835 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0872 - val_loss: 0.0607 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0796 - val_loss: 0.0775 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0713 - val_loss: 0.0670 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0705 - val_loss: 0.0693 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0670 - val_loss: 0.0627 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0631 - val_loss: 0.0579 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0585 - val_loss: 0.0581 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0570 - val_loss: 0.0548 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0535 - val_loss: 0.0554 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0516 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0493 - val_loss: 0.0578 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0470 - val_loss: 0.0597 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0452 - val_loss: 0.0608 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0449 - val_loss: 0.0596 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0453 - val_loss: 0.0604 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0431 - val_loss: 0.0612 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0439 - val_loss: 0.0603 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0606 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0608 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0427 - val_loss: 0.0610 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0441 - val_loss: 0.0612 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0608 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0426 - val_loss: 0.0606 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0443 - val_loss: 0.0607 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 3ms/step - loss: 0.0433 - val_loss: 0.0607 - lr: 2.4788e-06
Epoch 1/100

2023-11-27 18:40:50.437704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.438339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.438710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:50.492510: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.492996: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.493344: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:50.581647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.582171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.582586: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:50.645438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.646057: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.646588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:50.889364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.889938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.890431: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:50.949564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:50.950014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:50.950440: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 1s 9ms/step - loss: 0.1204 - val_loss: 0.1077 - lr: 0.0010
Epoch 2/100
 1/51 [..............................] - ETA: 0s - loss: 0.1147

2023-11-27 18:40:51.699355: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:51.700072: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:51.700469: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:40:51.767421: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:40:51.768125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:40:51.768682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

51/51 [==============================] - 0s 4ms/step - loss: 0.1118 - val_loss: 0.1009 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1101 - val_loss: 0.0987 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1042 - val_loss: 0.0896 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 0s 4ms/step - loss: 0.1022 - val_loss: 0.0898 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0997 - val_loss: 0.0842 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0979 - val_loss: 0.0836 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0950 - val_loss: 0.0821 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0924 - val_loss: 0.0785 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0928 - val_loss: 0.0806 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0860 - val_loss: 0.0718 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0845 - val_loss: 0.0707 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0652 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0721 - val_loss: 0.0626 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0674 - val_loss: 0.0591 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0566 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0582 - val_loss: 0.0556 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0561 - val_loss: 0.0540 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0548 - val_loss: 0.0521 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0535 - val_loss: 0.0532 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0523 - val_loss: 0.0521 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0506 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0493 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0517 - val_loss: 0.0478 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0505 - val_loss: 0.0483 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0480 - val_loss: 0.0493 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0486 - val_loss: 0.0498 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0484 - val_loss: 0.0505 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0504 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0468 - val_loss: 0.0511 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0507 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0465 - val_loss: 0.0503 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0505 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0452 - val_loss: 0.0507 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0455 - val_loss: 0.0510 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0446 - val_loss: 0.0508 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0457 - val_loss: 0.0507 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0508 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0459 - val_loss: 0.0508 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0508 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0450 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0508 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:41:00.435207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.435615: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.436074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:00.489113: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.489493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.489839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:00.571731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.572195: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.572606: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:00.632152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.632644: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.633115: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:00.879507: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.880393: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.880841: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:00.944635: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:00.945134: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:00.945523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 1s 8ms/step - loss: 0.1193 - val_loss: 0.1293 - lr: 0.0010
Epoch 2/100
 1/68 [..............................] - ETA: 0s - loss: 0.1398

2023-11-27 18:41:01.734198: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:01.734682: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:01.735339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:01.798380: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:01.799212: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:01.799690: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

68/68 [==============================] - 0s 4ms/step - loss: 0.1091 - val_loss: 0.1280 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 0s 4ms/step - loss: 0.1065 - val_loss: 0.1030 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0985 - val_loss: 0.0992 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0932 - val_loss: 0.0883 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0855 - val_loss: 0.0979 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0800 - val_loss: 0.1018 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0760 - val_loss: 0.1024 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0706 - val_loss: 0.1062 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0659 - val_loss: 0.1302 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0657 - val_loss: 0.1059 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0621 - val_loss: 0.0791 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0610 - val_loss: 0.0681 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0581 - val_loss: 0.0648 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0575 - val_loss: 0.0608 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0555 - val_loss: 0.0589 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0527 - val_loss: 0.0568 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0562 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0558 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0487 - val_loss: 0.0549 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0496 - val_loss: 0.0611 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0501 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0567 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0552 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0469 - val_loss: 0.0550 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0533 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0470 - val_loss: 0.0511 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0463 - val_loss: 0.0500 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0458 - val_loss: 0.0488 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0453 - val_loss: 0.0472 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0467 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0462 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0436 - val_loss: 0.0459 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0458 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0438 - val_loss: 0.0457 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0456 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0434 - val_loss: 0.0456 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0423 - val_loss: 0.0455 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0422 - val_loss: 0.0455 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0455 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0455 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0454 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0454 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0454 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0435 - val_loss: 0.0454 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0433 - val_loss: 0.0454 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0454 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0454 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0454 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0454 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0454 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0454 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0454 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0427 - val_loss: 0.0454 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0424 - val_loss: 0.0454 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0454 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0437 - val_loss: 0.0454 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0426 - val_loss: 0.0454 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0425 - val_loss: 0.0454 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0454 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0429 - val_loss: 0.0454 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0418 - val_loss: 0.0454 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0431 - val_loss: 0.0454 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0454 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0420 - val_loss: 0.0454 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0432 - val_loss: 0.0454 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0428 - val_loss: 0.0454 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 0s 4ms/step - loss: 0.0425 - val_loss: 0.0454 - lr: 1.1370e-14
Epoch 1/100

2023-11-27 18:41:21.096368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.096943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.097299: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:21.158498: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.159031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.159495: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:21.243826: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.244285: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.244733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:21.307667: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.308437: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.308819: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:21.544714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.545368: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.545822: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:21.613604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:21.614049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:21.614670: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 1s 7ms/step - loss: 0.1203 - val_loss: 0.0982 - lr: 0.0010
Epoch 2/100
 1/85 [..............................] - ETA: 0s - loss: 0.0700

2023-11-27 18:41:22.476205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:22.476699: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:22.477363: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:22.537658: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:22.538075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:22.538488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

85/85 [==============================] - 0s 4ms/step - loss: 0.1071 - val_loss: 0.0925 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0989 - val_loss: 0.0878 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0943 - val_loss: 0.0869 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0911 - val_loss: 0.0852 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0855 - val_loss: 0.0824 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0825 - val_loss: 0.0813 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0748 - val_loss: 0.0778 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0735 - val_loss: 0.0754 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0727 - val_loss: 0.0741 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0694 - val_loss: 0.0693 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0647 - val_loss: 0.0711 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0613 - val_loss: 0.0684 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0580 - val_loss: 0.0704 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0557 - val_loss: 0.0698 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0558 - val_loss: 0.0663 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0531 - val_loss: 0.0657 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0513 - val_loss: 0.0651 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0508 - val_loss: 0.0632 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0485 - val_loss: 0.0644 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0472 - val_loss: 0.0616 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0454 - val_loss: 0.0610 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0445 - val_loss: 0.0598 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0430 - val_loss: 0.0593 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0421 - val_loss: 0.0593 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0403 - val_loss: 0.0590 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0400 - val_loss: 0.0579 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0400 - val_loss: 0.0573 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0391 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0565 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0390 - val_loss: 0.0554 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0548 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0547 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0545 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0545 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0384 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0371 - val_loss: 0.0543 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0543 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0543 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0381 - val_loss: 0.0543 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0543 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0543 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0377 - val_loss: 0.0543 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0543 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0383 - val_loss: 0.0543 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0376 - val_loss: 0.0543 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0543 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0373 - val_loss: 0.0543 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0382 - val_loss: 0.0543 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0543 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0543 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0543 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0377 - val_loss: 0.0543 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0380 - val_loss: 0.0543 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0543 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0385 - val_loss: 0.0543 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0378 - val_loss: 0.0543 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0375 - val_loss: 0.0543 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0376 - val_loss: 0.0543 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 0s 3ms/step - loss: 0.0373 - val_loss: 0.0543 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0379 - val_loss: 0.0543 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 0s 4ms/step - loss: 0.0374 - val_loss: 0.0543 - lr: 5.6464e-15
Average Validation Loss: 0.058143099397420885
Current Best Configuration: {'neurons': 32, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100

2023-11-27 18:41:46.280526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.280941: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.281487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:46.334475: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.334862: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.335222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:46.416125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.416597: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.417026: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:46.479679: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.480175: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.480603: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:46.718297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.718896: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.719427: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:46.776971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:46.777416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:46.777833: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 36ms/step - loss: 0.1193 - val_loss: 0.1387 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0841

2023-11-27 18:41:47.376652: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:47.377241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:47.377642: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:47.436848: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:47.437262: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:47.437643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 6ms/step - loss: 0.1115 - val_loss: 0.1444 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1143 - val_loss: 0.1252 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 7ms/step - loss: 0.1038 - val_loss: 0.1191 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0949 - val_loss: 0.1205 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0932 - val_loss: 0.1200 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0926 - val_loss: 0.1114 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0807 - val_loss: 0.1118 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0777 - val_loss: 0.0980 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0652 - val_loss: 0.0998 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0643 - val_loss: 0.0888 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0550 - val_loss: 0.0988 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0476 - val_loss: 0.0954 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0487 - val_loss: 0.0840 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0460 - val_loss: 0.0872 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0430 - val_loss: 0.0911 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0428 - val_loss: 0.0879 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0424 - val_loss: 0.0925 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0421 - val_loss: 0.0892 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0427 - val_loss: 0.0830 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0417 - val_loss: 0.0898 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0415 - val_loss: 0.0851 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0410 - val_loss: 0.0853 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0417 - val_loss: 0.0822 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0403 - val_loss: 0.0932 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0417 - val_loss: 0.0856 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0392 - val_loss: 0.0877 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0404 - val_loss: 0.0872 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0409 - val_loss: 0.0862 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0413 - val_loss: 0.0856 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0425 - val_loss: 0.0852 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0401 - val_loss: 0.0856 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0402 - val_loss: 0.0854 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0410 - val_loss: 0.0869 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0396 - val_loss: 0.0876 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0401 - val_loss: 0.0880 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0402 - val_loss: 0.0877 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0402 - val_loss: 0.0873 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0394 - val_loss: 0.0871 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0408 - val_loss: 0.0870 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0396 - val_loss: 0.0869 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0389 - val_loss: 0.0869 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0407 - val_loss: 0.0868 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0406 - val_loss: 0.0868 - lr: 5.0045e-07
Epoch 1/100

2023-11-27 18:41:50.102228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.103089: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.103568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:50.161947: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.162364: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.162732: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:50.257480: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.258411: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.259222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:50.332099: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.333184: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.333886: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:50.572112: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.572792: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.573211: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:50.633562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:50.634082: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:50.634526: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1446 - val_loss: 0.0862 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0863

2023-11-27 18:41:51.120496: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:51.121025: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:51.121571: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:51.182160: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:51.182618: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:51.183006: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 4ms/step - loss: 0.1247 - val_loss: 0.0877 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1149 - val_loss: 0.0709 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1086 - val_loss: 0.0720 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 4ms/step - loss: 0.1037 - val_loss: 0.0711 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0972 - val_loss: 0.0771 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0907 - val_loss: 0.0807 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0700 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0822 - val_loss: 0.0728 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0768 - val_loss: 0.0829 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0742 - val_loss: 0.0757 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0723 - val_loss: 0.0662 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0681 - val_loss: 0.0620 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0636 - val_loss: 0.0648 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0589 - val_loss: 0.0683 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0580 - val_loss: 0.0699 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0569 - val_loss: 0.0649 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0569 - val_loss: 0.0537 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0550 - val_loss: 0.0565 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0519 - val_loss: 0.0582 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0549 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0571 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0540 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0556 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0561 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0571 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0584 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0579 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0582 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0571 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0568 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0570 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0571 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0568 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0565 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0565 - lr: 4.5166e-06
Epoch 1/100

2023-11-27 18:41:54.244389: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.244763: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.245226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:54.300574: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.300938: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.301294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:54.385977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.386419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.386852: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:54.448468: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.449008: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.449433: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:54.683731: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.684226: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.684684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:54.742669: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:54.743149: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:54.743585: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.1163 - val_loss: 0.1128 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0537

2023-11-27 18:41:55.407977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:55.408472: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:55.409136: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:41:55.473362: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:41:55.473788: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:41:55.474231: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.1020 - val_loss: 0.0930 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0980 - val_loss: 0.0873 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0958 - val_loss: 0.0821 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0916 - val_loss: 0.0784 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0879 - val_loss: 0.0779 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0862 - val_loss: 0.0780 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0839 - val_loss: 0.0749 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0780 - val_loss: 0.0720 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0741 - val_loss: 0.0609 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0702 - val_loss: 0.0602 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0646 - val_loss: 0.0559 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0643 - val_loss: 0.0601 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0667 - val_loss: 0.0632 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0573 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0681 - val_loss: 0.0518 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0665 - val_loss: 0.0504 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0603 - val_loss: 0.0491 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0481 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0476 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0558 - val_loss: 0.0460 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0501 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0517 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0513 - val_loss: 0.0514 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0499 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0505 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0510 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0499 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0500 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0497 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0493 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0499 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0493 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0493 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0470 - val_loss: 0.0495 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0497 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 6ms/step - loss: 0.0475 - val_loss: 0.0497 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0496 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0496 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0496 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:42:00.952741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:00.953172: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:00.953550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:01.009508: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:01.009905: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:01.010254: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:01.092144: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:01.092567: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:01.092977: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:01.153277: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:01.153772: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:01.154303: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:01.388477: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:01.389047: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:01.389476: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:01.447369: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:01.447828: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:01.448242: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1259 - val_loss: 0.1020 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0585

2023-11-27 18:42:02.143114: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:02.143685: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:02.144076: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:02.204870: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:02.205332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:02.205687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.1018 - val_loss: 0.1101 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0968 - val_loss: 0.1007 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0892 - val_loss: 0.0856 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0831 - val_loss: 0.0892 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0774 - val_loss: 0.0787 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0700 - val_loss: 0.0779 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0679 - val_loss: 0.0705 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0661 - val_loss: 0.0670 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0623 - val_loss: 0.0706 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0628 - val_loss: 0.0609 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0659 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0573 - val_loss: 0.0626 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0542 - val_loss: 0.0624 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0544 - val_loss: 0.0625 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0532 - val_loss: 0.0635 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0505 - val_loss: 0.0660 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0672 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0507 - val_loss: 0.0669 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0508 - val_loss: 0.0708 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0522 - val_loss: 0.0826 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0593 - val_loss: 0.0789 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0649 - val_loss: 0.0534 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0461 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0533 - val_loss: 0.0440 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0423 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0417 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0413 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0410 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0410 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0411 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0409 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0408 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0408 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0409 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0409 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0409 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0409 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0456 - val_loss: 0.0408 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0457 - val_loss: 0.0408 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0408 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0408 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0408 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0408 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0460 - val_loss: 0.0408 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0459 - val_loss: 0.0408 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0466 - val_loss: 0.0408 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0453 - val_loss: 0.0408 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0450 - val_loss: 0.0408 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0454 - val_loss: 0.0408 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0461 - val_loss: 0.0408 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0462 - val_loss: 0.0408 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0463 - val_loss: 0.0408 - lr: 1.0130e-08
Epoch 1/100

2023-11-27 18:42:11.196497: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:11.197009: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:11.197628: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:11.257557: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:11.257986: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:11.258332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:11.340188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:11.340710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:11.341171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:11.401673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:11.402171: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:11.402599: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:11.641234: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:11.641748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:11.642209: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:12.283590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:12.284227: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:12.284647: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 2s 10ms/step - loss: 0.1165 - val_loss: 0.1024 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0533

2023-11-27 18:42:13.017287: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:13.017767: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:13.018278: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:13.078319: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:13.078787: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:13.079146: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.0999 - val_loss: 0.0948 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0918 - val_loss: 0.0912 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0854 - val_loss: 0.0875 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0814 - val_loss: 0.0829 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0755 - val_loss: 0.0790 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0694 - val_loss: 0.0759 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0639 - val_loss: 0.0725 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0620 - val_loss: 0.0689 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0601 - val_loss: 0.0754 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0616 - val_loss: 0.0717 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0589 - val_loss: 0.0700 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0575 - val_loss: 0.0683 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0537 - val_loss: 0.0692 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0682 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0658 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0645 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0626 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0447 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0438 - val_loss: 0.0589 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0425 - val_loss: 0.0575 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0417 - val_loss: 0.0557 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0549 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0405 - val_loss: 0.0530 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0533 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0529 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0528 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.0525 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0509 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0507 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0504 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0502 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0502 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0501 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0502 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0501 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0501 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0501 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0383 - val_loss: 0.0501 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0384 - val_loss: 0.0501 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0501 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0501 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0501 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0501 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0501 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0501 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0387 - val_loss: 0.0501 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0501 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0501 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0501 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0385 - val_loss: 0.0501 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0390 - val_loss: 0.0501 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0501 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0382 - val_loss: 0.0501 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0399 - val_loss: 0.0501 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0501 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0388 - val_loss: 0.0501 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0501 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0501 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0389 - val_loss: 0.0501 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0391 - val_loss: 0.0501 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0393 - val_loss: 0.0501 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0384 - val_loss: 0.0501 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0384 - val_loss: 0.0501 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0392 - val_loss: 0.0501 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 5.6464e-15
Average Validation Loss: 0.054561803489923476
Current Best Configuration: {'neurons': 32, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100

2023-11-27 18:42:28.963106: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:28.963660: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:28.964014: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:29.021798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:29.022208: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:29.022562: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:29.102298: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:29.102809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:29.103267: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:29.167084: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:29.167758: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:29.168137: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:29.407778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:29.408564: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:29.409000: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:29.469034: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:29.469530: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:29.469951: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 1s 69ms/step - loss: 0.1740 - val_loss: 0.1295 - lr: 0.0010
Epoch 2/100
1/5 [=====>........................] - ETA: 0s - loss: 0.0849

2023-11-27 18:42:30.053946: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:30.054588: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:30.055004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:30.118133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:30.118590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:30.118968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

5/5 [==============================] - 0s 11ms/step - loss: 0.0969 - val_loss: 0.1422 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1081 - val_loss: 0.1573 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1148 - val_loss: 0.1515 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1078 - val_loss: 0.1363 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 11ms/step - loss: 0.1038 - val_loss: 0.1257 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0976 - val_loss: 0.1214 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0936 - val_loss: 0.1212 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0893 - val_loss: 0.1221 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0865 - val_loss: 0.1214 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0815 - val_loss: 0.1195 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0783 - val_loss: 0.1150 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0732 - val_loss: 0.1110 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0670 - val_loss: 0.1043 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0593 - val_loss: 0.1030 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 13ms/step - loss: 0.0564 - val_loss: 0.1017 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 13ms/step - loss: 0.0551 - val_loss: 0.1043 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0523 - val_loss: 0.1024 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0503 - val_loss: 0.1072 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0504 - val_loss: 0.1041 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0523 - val_loss: 0.1007 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0489 - val_loss: 0.1053 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0475 - val_loss: 0.1041 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0506 - val_loss: 0.1028 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 12ms/step - loss: 0.0480 - val_loss: 0.1019 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0486 - val_loss: 0.1028 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0497 - val_loss: 0.1033 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0486 - val_loss: 0.1024 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0482 - val_loss: 0.1022 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0496 - val_loss: 0.1018 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0470 - val_loss: 0.1017 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0490 - val_loss: 0.1021 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0485 - val_loss: 0.1020 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0470 - val_loss: 0.1020 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0481 - val_loss: 0.1022 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0476 - val_loss: 0.1025 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 13ms/step - loss: 0.0479 - val_loss: 0.1026 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0484 - val_loss: 0.1027 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0468 - val_loss: 0.1028 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 10ms/step - loss: 0.0478 - val_loss: 0.1029 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 11ms/step - loss: 0.0480 - val_loss: 0.1029 - lr: 1.6616e-06
Epoch 1/100

2023-11-27 18:42:32.378604: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.379039: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.379675: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:32.433382: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.433730: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.434069: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:32.516714: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.517230: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.517719: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:32.578536: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.579011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.579453: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:32.826404: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.827258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.828059: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:32.893522: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:32.893992: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:32.894428: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 37ms/step - loss: 0.1421 - val_loss: 0.0887 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.1459

2023-11-27 18:42:33.485032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:33.485515: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:33.486205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:33.547087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:33.547523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:33.547914: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 9ms/step - loss: 0.1249 - val_loss: 0.0855 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 8ms/step - loss: 0.1116 - val_loss: 0.0799 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1093 - val_loss: 0.0676 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 9ms/step - loss: 0.1025 - val_loss: 0.0828 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0966 - val_loss: 0.0692 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0875 - val_loss: 0.0766 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0791 - val_loss: 0.0885 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0797 - val_loss: 0.0732 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0714 - val_loss: 0.0697 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0660 - val_loss: 0.0673 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0634 - val_loss: 0.0672 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0637 - val_loss: 0.0725 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0605 - val_loss: 0.0631 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0592 - val_loss: 0.0650 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0585 - val_loss: 0.0655 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0567 - val_loss: 0.0595 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0566 - val_loss: 0.0556 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0549 - val_loss: 0.0584 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0554 - val_loss: 0.0572 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 11ms/step - loss: 0.0544 - val_loss: 0.0552 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0535 - val_loss: 0.0563 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0525 - val_loss: 0.0562 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0527 - val_loss: 0.0550 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0571 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0506 - val_loss: 0.0553 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0519 - val_loss: 0.0563 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0587 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0515 - val_loss: 0.0579 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0507 - val_loss: 0.0553 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0505 - val_loss: 0.0547 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0520 - val_loss: 0.0558 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0514 - val_loss: 0.0555 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0516 - val_loss: 0.0557 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0525 - val_loss: 0.0556 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0519 - val_loss: 0.0558 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0515 - val_loss: 0.0561 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0517 - val_loss: 0.0563 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0512 - val_loss: 0.0563 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0521 - val_loss: 0.0563 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0508 - val_loss: 0.0563 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0522 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0515 - val_loss: 0.0562 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 10ms/step - loss: 0.0517 - val_loss: 0.0563 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0515 - val_loss: 0.0563 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0516 - val_loss: 0.0562 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 11ms/step - loss: 0.0524 - val_loss: 0.0562 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0509 - val_loss: 0.0562 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0518 - val_loss: 0.0562 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0509 - val_loss: 0.0562 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 9ms/step - loss: 0.0515 - val_loss: 0.0562 - lr: 2.7536e-08
Epoch 1/100

2023-11-27 18:42:37.765523: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:37.766204: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:37.766654: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:37.818222: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:37.818612: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:37.818971: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:37.901482: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:37.902001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:37.902430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:37.961906: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:37.962352: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:37.962765: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:38.195499: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:38.195943: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:38.196381: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:38.253716: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:38.254188: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:38.254590: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 1s 28ms/step - loss: 0.1232 - val_loss: 0.1115 - lr: 0.0010
Epoch 2/100
 1/13 [=>............................] - ETA: 0s - loss: 0.1392

2023-11-27 18:42:38.886093: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:38.886733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:38.887409: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:38.954049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:38.954488: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:38.954882: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

13/13 [==============================] - 0s 8ms/step - loss: 0.1118 - val_loss: 0.1194 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0994 - val_loss: 0.1016 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0986 - val_loss: 0.0980 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0919 - val_loss: 0.0894 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0896 - val_loss: 0.0824 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0860 - val_loss: 0.0762 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0820 - val_loss: 0.0698 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0801 - val_loss: 0.0666 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0761 - val_loss: 0.0653 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0729 - val_loss: 0.0633 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0699 - val_loss: 0.0607 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0636 - val_loss: 0.0580 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0613 - val_loss: 0.0575 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0622 - val_loss: 0.0559 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0627 - val_loss: 0.0527 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0626 - val_loss: 0.0561 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0605 - val_loss: 0.0594 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 10ms/step - loss: 0.0543 - val_loss: 0.0534 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0537 - val_loss: 0.0515 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0538 - val_loss: 0.0503 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0510 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0509 - val_loss: 0.0493 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0501 - val_loss: 0.0488 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0506 - val_loss: 0.0495 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0484 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0501 - val_loss: 0.0486 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0494 - val_loss: 0.0489 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0494 - val_loss: 0.0486 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0500 - val_loss: 0.0483 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0484 - val_loss: 0.0482 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0487 - val_loss: 0.0482 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0502 - val_loss: 0.0480 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0480 - val_loss: 0.0480 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0476 - val_loss: 0.0480 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0494 - val_loss: 0.0481 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0482 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0482 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0477 - val_loss: 0.0481 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0492 - val_loss: 0.0481 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0484 - val_loss: 0.0481 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0481 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0489 - val_loss: 0.0481 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0476 - val_loss: 0.0481 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0490 - val_loss: 0.0481 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0491 - val_loss: 0.0481 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0496 - val_loss: 0.0481 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0495 - val_loss: 0.0481 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 9ms/step - loss: 0.0497 - val_loss: 0.0481 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0483 - val_loss: 0.0481 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0485 - val_loss: 0.0481 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0487 - val_loss: 0.0481 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0492 - val_loss: 0.0481 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 8ms/step - loss: 0.0482 - val_loss: 0.0481 - lr: 6.1442e-09
Epoch 1/100

2023-11-27 18:42:44.765942: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:44.766367: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:44.766940: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:44.825125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:44.825568: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:44.826011: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:44.906710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:44.907194: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:44.907608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:44.967399: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:44.968102: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:44.968608: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:45.203304: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:45.203975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:45.204413: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:45.271139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:45.271672: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:45.272159: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 22ms/step - loss: 0.1368 - val_loss: 0.1169 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.1441

2023-11-27 18:42:45.914900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:45.915405: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:45.915831: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:45.975633: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:45.976012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:45.976438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 8ms/step - loss: 0.1122 - val_loss: 0.0997 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0969 - val_loss: 0.1055 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0946 - val_loss: 0.1270 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0968 - val_loss: 0.1194 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0989 - val_loss: 0.0819 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0835 - val_loss: 0.0828 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0788 - val_loss: 0.1261 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0880 - val_loss: 0.1205 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0932 - val_loss: 0.0676 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0713 - val_loss: 0.0708 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0678 - val_loss: 0.0906 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0698 - val_loss: 0.0931 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0783 - val_loss: 0.0641 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0718 - val_loss: 0.0499 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0616 - val_loss: 0.0506 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0621 - val_loss: 0.0520 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0635 - val_loss: 0.0470 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0611 - val_loss: 0.0441 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0578 - val_loss: 0.0437 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 9ms/step - loss: 0.0559 - val_loss: 0.0435 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0553 - val_loss: 0.0432 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0550 - val_loss: 0.0431 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0537 - val_loss: 0.0432 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0544 - val_loss: 0.0429 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0535 - val_loss: 0.0427 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0537 - val_loss: 0.0426 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0530 - val_loss: 0.0425 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0424 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0526 - val_loss: 0.0425 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0423 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0535 - val_loss: 0.0423 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0527 - val_loss: 0.0423 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0423 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0423 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0523 - val_loss: 0.0423 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0517 - val_loss: 0.0423 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0528 - val_loss: 0.0423 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0530 - val_loss: 0.0423 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0513 - val_loss: 0.0423 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0423 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0522 - val_loss: 0.0423 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0524 - val_loss: 0.0423 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0521 - val_loss: 0.0423 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0423 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0523 - val_loss: 0.0423 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0529 - val_loss: 0.0423 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0519 - val_loss: 0.0423 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0520 - val_loss: 0.0423 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0519 - val_loss: 0.0423 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0515 - val_loss: 0.0423 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0526 - val_loss: 0.0423 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 7ms/step - loss: 0.0517 - val_loss: 0.0423 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0523 - val_loss: 0.0423 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0518 - val_loss: 0.0423 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0523 - val_loss: 0.0423 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0516 - val_loss: 0.0423 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 8ms/step - loss: 0.0525 - val_loss: 0.0423 - lr: 8.3153e-10
Epoch 1/100

2023-11-27 18:42:53.732912: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:53.733332: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:53.734022: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:53.790258: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:53.790602: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:53.790970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:53.871815: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:53.872294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:53.872739: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:53.932832: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:53.933294: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:53.933710: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:54.165981: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:54.166528: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:54.167051: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:54.225205: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:54.225596: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:54.226010: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 1s 18ms/step - loss: 0.1424 - val_loss: 0.1081 - lr: 0.0010
Epoch 2/100
 1/22 [>.............................] - ETA: 0s - loss: 0.1275

2023-11-27 18:42:54.903900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:54.904417: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:54.904786: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:42:54.969545: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:42:54.970028: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:42:54.970430: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

22/22 [==============================] - 0s 7ms/step - loss: 0.1145 - val_loss: 0.1075 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1063 - val_loss: 0.1024 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1014 - val_loss: 0.0993 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 7ms/step - loss: 0.1008 - val_loss: 0.0992 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 8ms/step - loss: 0.1002 - val_loss: 0.1017 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0990 - val_loss: 0.1013 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0963 - val_loss: 0.0997 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0917 - val_loss: 0.0938 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0892 - val_loss: 0.0938 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0885 - val_loss: 0.0979 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0866 - val_loss: 0.0955 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0826 - val_loss: 0.0888 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0766 - val_loss: 0.0881 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0714 - val_loss: 0.0851 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0665 - val_loss: 0.0788 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0628 - val_loss: 0.0778 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0613 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0614 - val_loss: 0.0806 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0631 - val_loss: 0.0832 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0631 - val_loss: 0.0750 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0578 - val_loss: 0.0675 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0538 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0511 - val_loss: 0.0619 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0504 - val_loss: 0.0605 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0497 - val_loss: 0.0602 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0486 - val_loss: 0.0590 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0489 - val_loss: 0.0585 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0584 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0578 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0487 - val_loss: 0.0582 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0579 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0578 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0479 - val_loss: 0.0579 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0578 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0577 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0481 - val_loss: 0.0577 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0576 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0576 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0477 - val_loss: 0.0576 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0471 - val_loss: 0.0576 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0488 - val_loss: 0.0576 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0477 - val_loss: 0.0576 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0576 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0484 - val_loss: 0.0576 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0475 - val_loss: 0.0576 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0489 - val_loss: 0.0576 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0576 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0471 - val_loss: 0.0576 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0576 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0477 - val_loss: 0.0576 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0481 - val_loss: 0.0576 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0576 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0477 - val_loss: 0.0576 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0485 - val_loss: 0.0576 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0482 - val_loss: 0.0576 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0477 - val_loss: 0.0576 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0489 - val_loss: 0.0576 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0483 - val_loss: 0.0576 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0576 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0482 - val_loss: 0.0576 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0486 - val_loss: 0.0576 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0476 - val_loss: 0.0576 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0487 - val_loss: 0.0576 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0472 - val_loss: 0.0576 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0476 - val_loss: 0.0576 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0488 - val_loss: 0.0576 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 8ms/step - loss: 0.0479 - val_loss: 0.0576 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0478 - val_loss: 0.0576 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0480 - val_loss: 0.0576 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 0s 7ms/step - loss: 0.0475 - val_loss: 0.0576 - lr: 5.6464e-15
Average Validation Loss: 0.060636195540428164
Current Best Configuration: {'neurons': 32, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 64}
Epoch 1/100

2023-11-27 18:43:07.248452: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.249032: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.249438: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:43:07.301818: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.302201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.302543: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:43:07.383937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.384420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.384840: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:43:07.443643: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.444125: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.444572: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:43:07.674975: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.675444: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.676012: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:43:07.733900: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:43:07.734370: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:43:07.734798: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

45/51 [=========================>....] - ETA: 0s - loss: 0.1248WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 1s 5ms/step - loss: 0.1236 - lr: 0.0010
Epoch 2/100
50/51 [============================>.] - ETA: 0s - loss: 0.0983WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0999 - lr: 0.0010
Epoch 3/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0958WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0929 - lr: 0.0010
Epoch 4/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0872WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0885 - lr: 0.0010
Epoch 5/100
40/51 [======================>.......] - ETA: 0s - loss: 0.0848WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0829 - lr: 0.0010
Epoch 6/100
50/51 [============================>.] - ETA: 0s - loss: 0.0763WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0774 - lr: 0.0010
Epoch 7/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0725WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0741 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - ETA: 0s - loss: 0.0674WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0674 - lr: 0.0010
Epoch 9/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0667WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0673 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - ETA: 0s - loss: 0.0620WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0620 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - ETA: 0s - loss: 0.0573WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0573 - lr: 9.0484e-04
Epoch 12/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0547WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0552 - lr: 8.1873e-04
Epoch 13/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0491WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0506 - lr: 7.4082e-04
Epoch 14/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0471WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0483 - lr: 6.7032e-04
Epoch 15/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0469WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0484 - lr: 6.0653e-04
Epoch 16/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0459WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0473 - lr: 5.4881e-04
Epoch 17/100
50/51 [============================>.] - ETA: 0s - loss: 0.0456WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0467 - lr: 4.9659e-04
Epoch 18/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0432WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0443 - lr: 4.4933e-04
Epoch 19/100
46/51 [==========================>...] - ETA: 0s - loss: 0.0427WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0435 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - ETA: 0s - loss: 0.0428WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0428 - lr: 3.6788e-04
Epoch 21/100
50/51 [============================>.] - ETA: 0s - loss: 0.0409WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0417 - lr: 3.0119e-04
Epoch 22/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0389WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0400 - lr: 2.4660e-04
Epoch 23/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0387WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0398 - lr: 2.0190e-04
Epoch 24/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0389WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0397 - lr: 1.6530e-04
Epoch 25/100
50/51 [============================>.] - ETA: 0s - loss: 0.0380WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0389 - lr: 1.3534e-04
Epoch 26/100
50/51 [============================>.] - ETA: 0s - loss: 0.0385WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0393 - lr: 1.1080e-04
Epoch 27/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0379WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0384 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - ETA: 0s - loss: 0.0383WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 7.4274e-05
Epoch 29/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0377WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0386 - lr: 6.0810e-05
Epoch 30/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0379WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0389 - lr: 4.9787e-05
Epoch 31/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0378WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0389 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - ETA: 0s - loss: 0.0393WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0393 - lr: 2.7324e-05
Epoch 33/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0381WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0388 - lr: 2.0242e-05
Epoch 34/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0378WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0386 - lr: 1.4996e-05
Epoch 35/100
50/51 [============================>.] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - ETA: 0s - loss: 0.0382WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - ETA: 0s - loss: 0.0377WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 6.0967e-06
Epoch 38/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0377WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 4.5166e-06
Epoch 39/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 3.3460e-06
Epoch 40/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0371WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 2.4788e-06
Epoch 41/100
50/51 [============================>.] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.6616e-06
Epoch 42/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 1.1138e-06
Epoch 43/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 7.4659e-07
Epoch 44/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0375WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0384 - lr: 5.0045e-07
Epoch 45/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0370WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0380 - lr: 3.3546e-07
Epoch 46/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0380 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - ETA: 0s - loss: 0.0378WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - ETA: 0s - loss: 0.0379WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.0104e-07
Epoch 49/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0376WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0385 - lr: 6.7729e-08
Epoch 50/100
40/51 [======================>.......] - ETA: 0s - loss: 0.0371WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 4.5400e-08
Epoch 51/100
50/51 [============================>.] - ETA: 0s - loss: 0.0370WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - ETA: 0s - loss: 0.0382WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 1.6702e-08
Epoch 53/100
50/51 [============================>.] - ETA: 0s - loss: 0.0368WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 1.0130e-08
Epoch 54/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0364WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0375 - lr: 6.1442e-09
Epoch 55/100
50/51 [============================>.] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 3.7267e-09
Epoch 56/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0374WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 2.2603e-09
Epoch 57/100
50/51 [============================>.] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 1.3710e-09
Epoch 58/100
50/51 [============================>.] - ETA: 0s - loss: 0.0365WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0375 - lr: 8.3153e-10
Epoch 59/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0366WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 5.0435e-10
Epoch 60/100
50/51 [============================>.] - ETA: 0s - loss: 0.0377WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0387 - lr: 3.0590e-10
Epoch 61/100
50/51 [============================>.] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0376 - lr: 1.6788e-10
Epoch 62/100
51/51 [==============================] - ETA: 0s - loss: 0.0380WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0380 - lr: 9.2136e-11
Epoch 63/100
50/51 [============================>.] - ETA: 0s - loss: 0.0368WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 5.0565e-11
Epoch 64/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0375 - lr: 2.7751e-11
Epoch 65/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0375WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0381 - lr: 1.5230e-11
Epoch 66/100
51/51 [==============================] - ETA: 0s - loss: 0.0377WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 8.3584e-12
Epoch 67/100
50/51 [============================>.] - ETA: 0s - loss: 0.0378WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0389 - lr: 4.5872e-12
Epoch 68/100
51/51 [==============================] - ETA: 0s - loss: 0.0381WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0381 - lr: 2.5175e-12
Epoch 69/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0370WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.3816e-12
Epoch 70/100
50/51 [============================>.] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 7.5826e-13
Epoch 71/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 3.7654e-13
Epoch 72/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0368WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 1.8698e-13
Epoch 73/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0372WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 9.2853e-14
Epoch 74/100
46/51 [==========================>...] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0381 - lr: 4.6110e-14
Epoch 75/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0375WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0383 - lr: 2.2897e-14
Epoch 76/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0375WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0386 - lr: 1.1370e-14
Epoch 77/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0363WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0373 - lr: 5.6464e-15
Epoch 78/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0375WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0386 - lr: 2.8039e-15
Epoch 79/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0366WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 1.3924e-15
Epoch 80/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 6.9144e-16
Epoch 81/100
50/51 [============================>.] - ETA: 0s - loss: 0.0368WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 3.1068e-16
Epoch 82/100
51/51 [==============================] - ETA: 0s - loss: 0.0379WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.3960e-16
Epoch 83/100
39/51 [=====================>........] - ETA: 0s - loss: 0.0371WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 6.2726e-17
Epoch 84/100
46/51 [==========================>...] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0376 - lr: 2.8185e-17
Epoch 85/100
50/51 [============================>.] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.2664e-17
Epoch 86/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0377 - lr: 5.6904e-18
Epoch 87/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0366WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0376 - lr: 2.5569e-18
Epoch 88/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0371WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0382 - lr: 1.1489e-18
Epoch 89/100
47/51 [==========================>...] - ETA: 0s - loss: 0.0368WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0377 - lr: 5.1622e-19
Epoch 90/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0380 - lr: 2.3195e-19
Epoch 91/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0373WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0381 - lr: 9.4305e-20
Epoch 92/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0380 - lr: 3.8341e-20
Epoch 93/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0369WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0379 - lr: 1.5588e-20
Epoch 94/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 6.3378e-21
Epoch 95/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0365WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0375 - lr: 2.5768e-21
Epoch 96/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0366WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0376 - lr: 1.0476e-21
Epoch 97/100
49/51 [===========================>..] - ETA: 0s - loss: 0.0366WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0378 - lr: 4.2594e-22
Epoch 98/100
48/51 [===========================>..] - ETA: 0s - loss: 0.0367WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0377 - lr: 1.7317e-22
Epoch 99/100
46/51 [==========================>...] - ETA: 0s - loss: 0.0378WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 5ms/step - loss: 0.0386 - lr: 7.0407e-23
Epoch 100/100
50/51 [============================>.] - ETA: 0s - loss: 0.0371WARNING:tensorflow:Early stopping conditioned on metric `val_loss` which is not available. Available metrics are: loss,lr
51/51 [==============================] - 0s 4ms/step - loss: 0.0381 - lr: 2.8625e-23

<keras.callbacks.History at 0x399b8d5d0>

1.3.6.3 3. Model Performance

While this model did not perform as well as many of the other five models developed, I still was able to achieve significant improvement in it. One can see that the LSTM Initial Models had much higher RMSEs and that I saw significant improvements after using the MinMaxScaler(), using forwards and backwards fill for imputation, and implementing cross-validation.

Furthermore, the graphs comparing the predictions to the actual values seem to make much more sense after implementing these changes. Before, it was difficult to understand why the graphs were such odd shapes, but the final graphs reflect a pattern similar to that of the XGBoost model developed using ungrouped data.

The final final metrics obtained were:

Training Metrics: MAE: 0.019462694273006197, RMSE: 0.030340060238547382, Training R-squared: 0.9538018193299438

Testing Metrics: MAE: 0.03335198051308351, RMSE: 0.045407351521714524, Testing R-squared: 0.8868747184643261

Code

# Make predictions with the trained model
train_pred = model_final.predict(X_train)
test_pred = model_final.predict(X_test)

# Calculate R-squared for training and testing sets
train_r2 = r2_score(y_train, train_pred)
test_r2 = r2_score(y_test, test_pred)

# Calculate and print performance metrics
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
print(f"Training Metrics: MAE: {mean_absolute_error(y_train, train_pred)}, RMSE: {train_rmse}, Training R-squared: {train_r2}")
print(f"Testing Metrics: MAE: {mean_absolute_error(y_test, test_pred)}, RMSE: {test_rmse}, Testing R-squared: {test_r2}")

 59/102 [================>.............] - ETA: 0s 

2023-11-27 18:44:22.345736: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:22.346396: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:22.346811: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:22.403733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:22.404180: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:22.404704: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

102/102 [==============================] - 0s 856us/step
34/34 [==============================] - 0s 801us/step
Training Metrics: MAE: 0.02121079630299121, RMSE: 0.038134981804889265, Training R-squared: 0.927014080708567
Testing Metrics: MAE: 0.04230103848619326, RMSE: 0.05986671997746208, Testing R-squared: 0.8033571052733279

Epoch 63/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0721 - val_loss: 0.0779 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0722 - val_loss: 0.0779 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0779 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0779 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0779 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0715 - val_loss: 0.0779 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0733 - val_loss: 0.0779 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0719 - val_loss: 0.0779 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0725 - val_loss: 0.0779 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0728 - val_loss: 0.0779 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0729 - val_loss: 0.0779 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0727 - val_loss: 0.0779 - lr: 2.2897e-14
Average Validation Loss: 0.0886541835963726
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 0.0001, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 65ms/step - loss: 0.1725 - val_loss: 0.1339 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1133 - val_loss: 0.1320 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1099 - val_loss: 0.1276 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1050 - val_loss: 0.1272 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1039 - val_loss: 0.1239 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1022 - val_loss: 0.1222 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0920 - val_loss: 0.1223 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0953 - val_loss: 0.1158 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0751 - val_loss: 0.1288 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0866 - val_loss: 0.1279 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0924 - val_loss: 0.1130 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0652 - val_loss: 0.1132 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0603 - val_loss: 0.1116 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0594 - val_loss: 0.1042 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0548 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.1000 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0492 - val_loss: 0.0983 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0553 - val_loss: 0.1181 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0496 - val_loss: 0.1107 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0489 - val_loss: 0.0968 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0449 - val_loss: 0.1122 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.1051 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0454 - val_loss: 0.1117 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0991 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0469 - val_loss: 0.1049 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0452 - val_loss: 0.1092 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0461 - val_loss: 0.1008 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0425 - val_loss: 0.1085 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0460 - val_loss: 0.1026 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0438 - val_loss: 0.1046 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0437 - val_loss: 0.1019 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0439 - val_loss: 0.1003 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0440 - val_loss: 0.1018 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0436 - val_loss: 0.1013 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0430 - val_loss: 0.1020 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0443 - val_loss: 0.1013 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0431 - val_loss: 0.1012 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0423 - val_loss: 0.1015 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0429 - val_loss: 0.1018 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0434 - val_loss: 0.1019 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 5s 38ms/step - loss: 0.1674 - val_loss: 0.0861 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1271 - val_loss: 0.0874 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1228 - val_loss: 0.0794 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1209 - val_loss: 0.0779 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1182 - val_loss: 0.0741 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1151 - val_loss: 0.0745 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1136 - val_loss: 0.0714 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1110 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1111 - val_loss: 0.0717 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1090 - val_loss: 0.0735 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1048 - val_loss: 0.0786 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0983 - val_loss: 0.0746 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1001 - val_loss: 0.0709 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0926 - val_loss: 0.0827 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0905 - val_loss: 0.0742 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0846 - val_loss: 0.0789 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0807 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0776 - val_loss: 0.0772 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0737 - val_loss: 0.0796 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0709 - val_loss: 0.0744 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0720 - val_loss: 0.0690 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0690 - val_loss: 0.0712 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0653 - val_loss: 0.0745 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0650 - val_loss: 0.0759 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0638 - val_loss: 0.0757 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0626 - val_loss: 0.0785 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0773 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0619 - val_loss: 0.0763 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0785 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0606 - val_loss: 0.0777 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0618 - val_loss: 0.0790 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0602 - val_loss: 0.0786 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0601 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0788 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0791 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0601 - val_loss: 0.0790 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0611 - val_loss: 0.0785 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0598 - val_loss: 0.0781 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0612 - val_loss: 0.0783 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0784 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0610 - val_loss: 0.0785 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 32ms/step - loss: 0.1204 - val_loss: 0.1086 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1083 - val_loss: 0.0994 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1022 - val_loss: 0.0925 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0991 - val_loss: 0.0886 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0974 - val_loss: 0.0893 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0901 - val_loss: 0.0833 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0924 - val_loss: 0.0862 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0848 - val_loss: 0.0822 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0820 - val_loss: 0.0818 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0793 - val_loss: 0.0737 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0750 - val_loss: 0.0726 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0692 - val_loss: 0.0688 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0640 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0621 - val_loss: 0.0637 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0598 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0551 - val_loss: 0.0597 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0550 - val_loss: 0.0614 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0543 - val_loss: 0.0591 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0595 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0527 - val_loss: 0.0612 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0557 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0564 - val_loss: 0.0552 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0533 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0527 - val_loss: 0.0524 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0519 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0507 - val_loss: 0.0514 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0512 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0498 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0484 - val_loss: 0.0511 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0485 - val_loss: 0.0510 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0508 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0507 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0482 - val_loss: 0.0507 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0507 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0481 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0507 - lr: 5.0045e-07

Epoch 45/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0507 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0465 - val_loss: 0.0507 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0507 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0507 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0470 - val_loss: 0.0507 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0507 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0478 - val_loss: 0.0507 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0507 - lr: 1.3710e-09
Epoch 1/100
68/68 [==============================] - 5s 26ms/step - loss: 0.1279 - val_loss: 0.1179 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1153 - val_loss: 0.1186 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1097 - val_loss: 0.1163 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1065 - val_loss: 0.1209 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1016 - val_loss: 0.1153 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0981 - val_loss: 0.1016 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0920 - val_loss: 0.0989 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0804 - val_loss: 0.1226 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0749 - val_loss: 0.1520 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0748 - val_loss: 0.1265 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0685 - val_loss: 0.1053 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0646 - val_loss: 0.0872 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0628 - val_loss: 0.0830 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0607 - val_loss: 0.0747 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0620 - val_loss: 0.0643 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0622 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0552 - val_loss: 0.0625 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0547 - val_loss: 0.0605 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0530 - val_loss: 0.0578 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0512 - val_loss: 0.0589 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0500 - val_loss: 0.0585 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0500 - val_loss: 0.0638 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0491 - val_loss: 0.0634 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0501 - val_loss: 0.0639 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0505 - val_loss: 0.0581 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0492 - val_loss: 0.0584 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0558 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0526 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0494 - val_loss: 0.0493 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0486 - val_loss: 0.0478 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0487 - val_loss: 0.0476 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0477 - val_loss: 0.0474 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0467 - val_loss: 0.0472 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0460 - val_loss: 0.0469 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0468 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0469 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0468 - val_loss: 0.0469 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0468 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0463 - val_loss: 0.0468 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0467 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0460 - val_loss: 0.0467 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0458 - val_loss: 0.0467 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0459 - val_loss: 0.0467 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0466 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0463 - val_loss: 0.0466 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0466 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0466 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0465 - val_loss: 0.0466 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0467 - val_loss: 0.0466 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0466 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0466 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0466 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0458 - val_loss: 0.0466 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.3710e-09

Epoch 58/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0466 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0466 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0459 - val_loss: 0.0466 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0465 - val_loss: 0.0466 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0466 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0466 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0466 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0468 - val_loss: 0.0466 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0466 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0455 - val_loss: 0.0466 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0466 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0466 - val_loss: 0.0466 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0466 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0466 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0464 - val_loss: 0.0466 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0454 - val_loss: 0.0466 - lr: 3.1068e-16
Epoch 1/100
85/85 [==============================] - 7s 48ms/step - loss: 0.1247 - val_loss: 0.1051 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1090 - val_loss: 0.0986 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0993 - val_loss: 0.0959 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0933 - val_loss: 0.0948 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0919 - val_loss: 0.0919 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 3s 33ms/step - loss: 0.0861 - val_loss: 0.0898 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0836 - val_loss: 0.0891 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0790 - val_loss: 0.0859 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0757 - val_loss: 0.0806 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0654 - val_loss: 0.0789 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0658 - val_loss: 0.0742 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0621 - val_loss: 0.0726 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0581 - val_loss: 0.0680 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0592 - val_loss: 0.0668 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0573 - val_loss: 0.0635 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0553 - val_loss: 0.0638 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0541 - val_loss: 0.0608 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0536 - val_loss: 0.0606 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0518 - val_loss: 0.0583 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0579 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0568 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0475 - val_loss: 0.0581 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0452 - val_loss: 0.0576 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0564 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0568 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0438 - val_loss: 0.0569 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0430 - val_loss: 0.0578 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0433 - val_loss: 0.0568 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0427 - val_loss: 0.0563 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0421 - val_loss: 0.0556 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0420 - val_loss: 0.0557 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0413 - val_loss: 0.0557 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0414 - val_loss: 0.0553 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0418 - val_loss: 0.0551 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0410 - val_loss: 0.0550 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0409 - val_loss: 0.0549 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0405 - val_loss: 0.0548 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0404 - val_loss: 0.0548 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0403 - val_loss: 0.0548 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0407 - val_loss: 0.0548 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0404 - val_loss: 0.0548 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 2.2487e-07

Epoch 47/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0414 - val_loss: 0.0548 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0409 - val_loss: 0.0548 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0400 - val_loss: 0.0548 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0416 - val_loss: 0.0548 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0409 - val_loss: 0.0548 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0408 - val_loss: 0.0548 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0421 - val_loss: 0.0548 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0405 - val_loss: 0.0548 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0413 - val_loss: 0.0548 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0410 - val_loss: 0.0548 - lr: 8.3153e-10
Average Validation Loss: 0.06358843743801117
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 5s 125ms/step - loss: 0.2039 - val_loss: 0.1432 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1072 - val_loss: 0.1437 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1117 - val_loss: 0.1482 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1136 - val_loss: 0.1394 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1070 - val_loss: 0.1306 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1004 - val_loss: 0.1271 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0995 - val_loss: 0.1270 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0937 - val_loss: 0.1281 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0921 - val_loss: 0.1290 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0898 - val_loss: 0.1253 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0864 - val_loss: 0.1241 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0822 - val_loss: 0.1175 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0774 - val_loss: 0.1166 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0728 - val_loss: 0.1152 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0716 - val_loss: 0.1103 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0623 - val_loss: 0.1144 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0655 - val_loss: 0.1074 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0580 - val_loss: 0.1082 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0560 - val_loss: 0.1048 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0542 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0523 - val_loss: 0.1046 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0519 - val_loss: 0.1047 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0500 - val_loss: 0.1055 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0515 - val_loss: 0.1034 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0502 - val_loss: 0.1015 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.1015 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0482 - val_loss: 0.1013 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.1007 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0494 - val_loss: 0.1004 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0487 - val_loss: 0.1001 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0499 - val_loss: 0.1004 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0492 - val_loss: 0.1003 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0503 - val_loss: 0.1003 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 1s 65ms/step - loss: 0.0492 - val_loss: 0.1003 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0506 - val_loss: 0.1003 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0491 - val_loss: 0.1005 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0513 - val_loss: 0.1006 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0499 - val_loss: 0.1006 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0480 - val_loss: 0.1005 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0489 - val_loss: 0.1005 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.1005 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0505 - val_loss: 0.1005 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0483 - val_loss: 0.1005 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0501 - val_loss: 0.1005 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0503 - val_loss: 0.1005 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0499 - val_loss: 0.1004 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0497 - val_loss: 0.1004 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0486 - val_loss: 0.1004 - lr: 4.5400e-08
Epoch 1/100
17/17 [==============================] - 4s 62ms/step - loss: 0.1562 - val_loss: 0.0933 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1245 - val_loss: 0.0856 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1214 - val_loss: 0.0818 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1184 - val_loss: 0.0784 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1131 - val_loss: 0.0730 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1055 - val_loss: 0.0666 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0992 - val_loss: 0.0626 - lr: 0.0010

Epoch 8/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0913 - val_loss: 0.0617 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0865 - val_loss: 0.0586 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0823 - val_loss: 0.0653 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0743 - val_loss: 0.0639 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0695 - val_loss: 0.0560 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0673 - val_loss: 0.0527 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0672 - val_loss: 0.0500 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0744 - val_loss: 0.0618 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0640 - val_loss: 0.0794 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0603 - val_loss: 0.0638 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0574 - val_loss: 0.0581 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0559 - val_loss: 0.0554 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0563 - val_loss: 0.0538 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0544 - val_loss: 0.0608 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0522 - val_loss: 0.0610 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0512 - val_loss: 0.0595 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0508 - val_loss: 0.0593 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0512 - val_loss: 0.0576 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0510 - val_loss: 0.0562 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0497 - val_loss: 0.0593 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0515 - val_loss: 0.0571 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0487 - val_loss: 0.0582 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0485 - val_loss: 0.0573 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0494 - val_loss: 0.0587 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0489 - val_loss: 0.0580 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0486 - val_loss: 0.0575 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0494 - val_loss: 0.0574 - lr: 1.4996e-05
Epoch 1/100
26/26 [==============================] - 5s 75ms/step - loss: 0.1459 - val_loss: 0.1237 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1200 - val_loss: 0.1250 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1065 - val_loss: 0.1077 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1023 - val_loss: 0.0968 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0967 - val_loss: 0.0906 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0937 - val_loss: 0.0849 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0904 - val_loss: 0.0810 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0904 - val_loss: 0.0781 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0843 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0828 - val_loss: 0.0729 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0796 - val_loss: 0.0702 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0768 - val_loss: 0.0663 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0722 - val_loss: 0.0629 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0599 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0656 - val_loss: 0.0572 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0643 - val_loss: 0.0561 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0638 - val_loss: 0.0554 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0661 - val_loss: 0.0529 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0653 - val_loss: 0.0540 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0640 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0579 - val_loss: 0.0601 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0559 - val_loss: 0.0560 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0546 - val_loss: 0.0562 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0532 - val_loss: 0.0555 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0533 - val_loss: 0.0546 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0530 - val_loss: 0.0554 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0515 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0552 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0517 - val_loss: 0.0545 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0534 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0544 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0516 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0507 - val_loss: 0.0541 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0502 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 1/100
34/34 [==============================] - 6s 47ms/step - loss: 0.1254 - val_loss: 0.1079 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1073 - val_loss: 0.1047 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1005 - val_loss: 0.1115 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0990 - val_loss: 0.1120 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0945 - val_loss: 0.1045 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0894 - val_loss: 0.1117 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0884 - val_loss: 0.1141 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0854 - val_loss: 0.1169 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0834 - val_loss: 0.1109 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0789 - val_loss: 0.1035 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0754 - val_loss: 0.1082 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0738 - val_loss: 0.1058 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0964 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0675 - val_loss: 0.0960 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0662 - val_loss: 0.0977 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0671 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0705 - val_loss: 0.0966 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0909 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0700 - val_loss: 0.0760 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0641 - val_loss: 0.0750 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0632 - val_loss: 0.0690 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0604 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0596 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0568 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0563 - val_loss: 0.0559 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0541 - val_loss: 0.0548 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0544 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0546 - val_loss: 0.0543 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0539 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0534 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0522 - val_loss: 0.0528 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0528 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0528 - val_loss: 0.0523 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0520 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0530 - val_loss: 0.0518 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0531 - val_loss: 0.0518 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0522 - val_loss: 0.0518 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0518 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0515 - val_loss: 0.0517 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0533 - val_loss: 0.0517 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0527 - val_loss: 0.0517 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0517 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0516 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0516 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0516 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0526 - val_loss: 0.0516 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0516 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0522 - val_loss: 0.0516 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0526 - val_loss: 0.0516 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0525 - val_loss: 0.0516 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0511 - val_loss: 0.0516 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0527 - val_loss: 0.0516 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0521 - val_loss: 0.0516 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0535 - val_loss: 0.0516 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0528 - val_loss: 0.0516 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0527 - val_loss: 0.0516 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0534 - val_loss: 0.0516 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0516 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0534 - val_loss: 0.0516 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0516 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0520 - val_loss: 0.0516 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0532 - val_loss: 0.0516 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0537 - val_loss: 0.0516 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0516 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0516 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0516 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0530 - val_loss: 0.0516 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0516 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0516 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0516 - lr: 2.2897e-14

Epoch 76/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0536 - val_loss: 0.0516 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 5s 39ms/step - loss: 0.1358 - val_loss: 0.1069 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1094 - val_loss: 0.1028 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0975 - val_loss: 0.0966 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0862 - val_loss: 0.0908 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0806 - val_loss: 0.0886 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0763 - val_loss: 0.0875 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0778 - val_loss: 0.0856 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0830 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0722 - val_loss: 0.0841 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0716 - val_loss: 0.0815 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0666 - val_loss: 0.0811 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0641 - val_loss: 0.0788 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0757 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0570 - val_loss: 0.0749 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0561 - val_loss: 0.0710 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0528 - val_loss: 0.0696 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0528 - val_loss: 0.0686 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0508 - val_loss: 0.0672 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0663 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0481 - val_loss: 0.0655 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0469 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0466 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0460 - val_loss: 0.0655 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0469 - val_loss: 0.0664 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0467 - val_loss: 0.0676 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0473 - val_loss: 0.0657 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0472 - val_loss: 0.0636 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0621 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0611 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0442 - val_loss: 0.0604 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0445 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0446 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0598 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0598 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0597 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0438 - val_loss: 0.0597 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0436 - val_loss: 0.0597 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0432 - val_loss: 0.0596 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0429 - val_loss: 0.0597 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0439 - val_loss: 0.0597 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0596 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0434 - val_loss: 0.0596 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0442 - val_loss: 0.0596 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0596 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0444 - val_loss: 0.0596 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0596 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0431 - val_loss: 0.0596 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0596 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0441 - val_loss: 0.0596 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0433 - val_loss: 0.0596 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0432 - val_loss: 0.0596 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0596 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0435 - val_loss: 0.0596 - lr: 1.3816e-12

Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0436 - val_loss: 0.0596 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0430 - val_loss: 0.0596 - lr: 3.7654e-13
Average Validation Loss: 0.06284483596682548
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 64}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 219ms/step - loss: 0.1605 - val_loss: 0.1323 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1103 - val_loss: 0.1245 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1017 - val_loss: 0.1305 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1061 - val_loss: 0.1380 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1092 - val_loss: 0.1398 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1133 - val_loss: 0.1356 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1052 - val_loss: 0.1295 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1022 - val_loss: 0.1259 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1001 - val_loss: 0.1229 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0991 - val_loss: 0.1204 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0944 - val_loss: 0.1200 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0931 - val_loss: 0.1218 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0898 - val_loss: 0.1223 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0895 - val_loss: 0.1207 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0892 - val_loss: 0.1182 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0854 - val_loss: 0.1160 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0845 - val_loss: 0.1157 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0811 - val_loss: 0.1151 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0791 - val_loss: 0.1134 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0791 - val_loss: 0.1133 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0798 - val_loss: 0.1129 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0768 - val_loss: 0.1130 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0784 - val_loss: 0.1113 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0730 - val_loss: 0.1103 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0752 - val_loss: 0.1095 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0708 - val_loss: 0.1090 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0721 - val_loss: 0.1088 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0728 - val_loss: 0.1090 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0731 - val_loss: 0.1094 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0710 - val_loss: 0.1096 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0704 - val_loss: 0.1098 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0725 - val_loss: 0.1098 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 49ms/step - loss: 0.0719 - val_loss: 0.1098 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0706 - val_loss: 0.1098 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 48ms/step - loss: 0.0729 - val_loss: 0.1097 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0729 - val_loss: 0.1096 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0684 - val_loss: 0.1096 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 70ms/step - loss: 0.0729 - val_loss: 0.1095 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0716 - val_loss: 0.1095 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0710 - val_loss: 0.1095 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0723 - val_loss: 0.1095 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0733 - val_loss: 0.1095 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0731 - val_loss: 0.1095 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0712 - val_loss: 0.1095 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0713 - val_loss: 0.1095 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0714 - val_loss: 0.1095 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0728 - val_loss: 0.1095 - lr: 1.5073e-07
Epoch 1/100
9/9 [==============================] - 5s 167ms/step - loss: 0.1685 - val_loss: 0.1032 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1227 - val_loss: 0.0788 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1219 - val_loss: 0.0765 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1153 - val_loss: 0.0832 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1111 - val_loss: 0.0798 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1034 - val_loss: 0.0762 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0990 - val_loss: 0.0806 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0917 - val_loss: 0.0734 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0852 - val_loss: 0.0709 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0815 - val_loss: 0.0722 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0783 - val_loss: 0.0743 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0741 - val_loss: 0.0788 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0739 - val_loss: 0.0772 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0718 - val_loss: 0.0781 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0700 - val_loss: 0.0755 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0689 - val_loss: 0.0793 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0704 - val_loss: 0.0766 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0680 - val_loss: 0.0752 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 46ms/step - loss: 0.0679 - val_loss: 0.0793 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0660 - val_loss: 0.0743 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0660 - val_loss: 0.0785 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0670 - val_loss: 0.0751 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0659 - val_loss: 0.0752 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0655 - val_loss: 0.0767 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0650 - val_loss: 0.0764 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0645 - val_loss: 0.0767 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0653 - val_loss: 0.0785 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0668 - val_loss: 0.0784 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0646 - val_loss: 0.0770 - lr: 6.0810e-05
Epoch 1/100
13/13 [==============================] - 4s 89ms/step - loss: 0.1139 - val_loss: 0.1180 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1060 - val_loss: 0.1146 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1007 - val_loss: 0.1055 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0937 - val_loss: 0.0945 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0896 - val_loss: 0.0829 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0844 - val_loss: 0.0745 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0824 - val_loss: 0.0697 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0773 - val_loss: 0.0673 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0769 - val_loss: 0.0657 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0729 - val_loss: 0.0650 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0717 - val_loss: 0.0640 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0697 - val_loss: 0.0651 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0675 - val_loss: 0.0617 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0661 - val_loss: 0.0596 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0655 - val_loss: 0.0603 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0657 - val_loss: 0.0637 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0618 - val_loss: 0.0601 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0615 - val_loss: 0.0575 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0634 - val_loss: 0.0643 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0602 - val_loss: 0.0582 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0595 - val_loss: 0.0588 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0580 - val_loss: 0.0556 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0592 - val_loss: 0.0588 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0581 - val_loss: 0.0557 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0579 - val_loss: 0.0573 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0577 - val_loss: 0.0572 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0576 - val_loss: 0.0572 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0568 - val_loss: 0.0568 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0558 - val_loss: 0.0575 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0570 - val_loss: 0.0566 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0574 - val_loss: 0.0564 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0576 - val_loss: 0.0570 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0566 - val_loss: 0.0575 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0568 - val_loss: 0.0580 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0559 - val_loss: 0.0578 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0568 - val_loss: 0.0575 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0563 - val_loss: 0.0574 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0571 - val_loss: 0.0572 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0571 - val_loss: 0.0571 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0566 - val_loss: 0.0571 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0562 - val_loss: 0.0571 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0575 - val_loss: 0.0571 - lr: 1.1138e-06
Epoch 1/100
17/17 [==============================] - 4s 72ms/step - loss: 0.1840 - val_loss: 0.1196 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1169 - val_loss: 0.1096 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1160 - val_loss: 0.1021 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1069 - val_loss: 0.1000 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0998 - val_loss: 0.0972 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0954 - val_loss: 0.1039 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0936 - val_loss: 0.0972 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0890 - val_loss: 0.0994 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0869 - val_loss: 0.1014 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0856 - val_loss: 0.1000 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0829 - val_loss: 0.0901 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0783 - val_loss: 0.0857 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0745 - val_loss: 0.0894 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0746 - val_loss: 0.0855 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0733 - val_loss: 0.0818 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0719 - val_loss: 0.0748 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0657 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0657 - val_loss: 0.0741 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0654 - val_loss: 0.0716 - lr: 4.0657e-04
Epoch 20/100

17/17 [==============================] - 0s 29ms/step - loss: 0.0630 - val_loss: 0.0677 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0632 - val_loss: 0.0614 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0608 - val_loss: 0.0578 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0569 - val_loss: 0.0564 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0551 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0548 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0545 - val_loss: 0.0537 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0550 - val_loss: 0.0532 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0552 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0534 - val_loss: 0.0529 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0545 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0536 - val_loss: 0.0517 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0531 - val_loss: 0.0515 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0515 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0539 - val_loss: 0.0515 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0522 - val_loss: 0.0515 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0524 - val_loss: 0.0516 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0537 - val_loss: 0.0515 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0514 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0514 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0540 - val_loss: 0.0514 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0527 - val_loss: 0.0514 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0529 - val_loss: 0.0513 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0540 - val_loss: 0.0513 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0530 - val_loss: 0.0513 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0513 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0540 - val_loss: 0.0513 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0513 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0533 - val_loss: 0.0513 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0534 - val_loss: 0.0513 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0541 - val_loss: 0.0513 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0523 - val_loss: 0.0513 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0537 - val_loss: 0.0513 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0526 - val_loss: 0.0513 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0538 - val_loss: 0.0513 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0513 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0529 - val_loss: 0.0513 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0527 - val_loss: 0.0513 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0535 - val_loss: 0.0513 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0534 - val_loss: 0.0513 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0536 - val_loss: 0.0513 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0530 - val_loss: 0.0513 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0513 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0537 - val_loss: 0.0513 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0513 - lr: 9.2853e-14
Epoch 1/100
22/22 [==============================] - 5s 64ms/step - loss: 0.1338 - val_loss: 0.1064 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 21ms/step - loss: 0.1061 - val_loss: 0.1018 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0992 - val_loss: 0.1013 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0955 - val_loss: 0.1030 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0969 - val_loss: 0.1014 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0908 - val_loss: 0.0957 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0873 - val_loss: 0.0946 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0837 - val_loss: 0.0928 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0826 - val_loss: 0.0940 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0855 - val_loss: 0.0957 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0831 - val_loss: 0.0900 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0768 - val_loss: 0.0878 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0738 - val_loss: 0.0844 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0703 - val_loss: 0.0825 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0695 - val_loss: 0.0823 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0675 - val_loss: 0.0788 - lr: 5.4881e-04

Epoch 17/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0647 - val_loss: 0.0773 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0633 - val_loss: 0.0764 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0618 - val_loss: 0.0730 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0603 - val_loss: 0.0733 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0593 - val_loss: 0.0699 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0570 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0536 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0532 - val_loss: 0.0598 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0527 - val_loss: 0.0576 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0581 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0514 - val_loss: 0.0572 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0511 - val_loss: 0.0561 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0518 - val_loss: 0.0562 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0507 - val_loss: 0.0558 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0513 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0504 - val_loss: 0.0550 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0503 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0501 - val_loss: 0.0546 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0507 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0501 - val_loss: 0.0545 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0497 - val_loss: 0.0545 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0505 - val_loss: 0.0545 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0506 - val_loss: 0.0545 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0502 - val_loss: 0.0545 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0545 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0508 - val_loss: 0.0545 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0499 - val_loss: 0.0545 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0503 - val_loss: 0.0545 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0501 - val_loss: 0.0545 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0504 - val_loss: 0.0545 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0500 - val_loss: 0.0545 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0545 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0502 - val_loss: 0.0545 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0500 - val_loss: 0.0545 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0514 - val_loss: 0.0545 - lr: 2.2603e-09
Average Validation Loss: 0.06820691674947739
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 0.0001, 'batch_size': 64}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 92ms/step - loss: 0.1059 - val_loss: 0.1344 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1125 - val_loss: 0.1219 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1050 - val_loss: 0.1174 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0954 - val_loss: 0.1188 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0969 - val_loss: 0.1158 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0919 - val_loss: 0.1156 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0928 - val_loss: 0.1104 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0841 - val_loss: 0.1140 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0879 - val_loss: 0.1068 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0716 - val_loss: 0.1026 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0579 - val_loss: 0.1026 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0522 - val_loss: 0.1090 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0525 - val_loss: 0.1003 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.1057 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0466 - val_loss: 0.1059 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0479 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0434 - val_loss: 0.0856 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0428 - val_loss: 0.0961 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0457 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0438 - val_loss: 0.0982 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0452 - val_loss: 0.0841 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0411 - val_loss: 0.1033 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0428 - val_loss: 0.0875 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0417 - val_loss: 0.0940 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0433 - val_loss: 0.0889 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0405 - val_loss: 0.0910 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0410 - val_loss: 0.0904 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0409 - val_loss: 0.0871 - lr: 7.4274e-05

Epoch 29/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0392 - val_loss: 0.0895 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0422 - val_loss: 0.0912 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0398 - val_loss: 0.0910 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0406 - val_loss: 0.0889 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0402 - val_loss: 0.0898 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0393 - val_loss: 0.0899 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0398 - val_loss: 0.0900 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0387 - val_loss: 0.0893 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0397 - val_loss: 0.0893 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0393 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0397 - val_loss: 0.0893 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0390 - val_loss: 0.0895 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0399 - val_loss: 0.0894 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.1158 - val_loss: 0.0700 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1094 - val_loss: 0.0785 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1087 - val_loss: 0.0751 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1063 - val_loss: 0.0653 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1030 - val_loss: 0.0750 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0974 - val_loss: 0.0680 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0985 - val_loss: 0.0736 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0926 - val_loss: 0.0671 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0937 - val_loss: 0.0628 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0923 - val_loss: 0.0612 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0894 - val_loss: 0.0651 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0809 - val_loss: 0.0706 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0819 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0788 - val_loss: 0.0611 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0733 - val_loss: 0.0616 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0712 - val_loss: 0.0596 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0655 - val_loss: 0.0569 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0656 - val_loss: 0.0543 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0613 - val_loss: 0.0551 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0592 - val_loss: 0.0557 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0562 - val_loss: 0.0542 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0548 - val_loss: 0.0494 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0516 - val_loss: 0.0534 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0505 - val_loss: 0.0520 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0502 - val_loss: 0.0496 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0527 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0495 - val_loss: 0.0499 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0490 - val_loss: 0.0523 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0479 - val_loss: 0.0534 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0470 - val_loss: 0.0549 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0468 - val_loss: 0.0536 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0470 - val_loss: 0.0524 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0534 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0468 - val_loss: 0.0539 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0473 - val_loss: 0.0542 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0488 - val_loss: 0.0544 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0478 - val_loss: 0.0543 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0463 - val_loss: 0.0543 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0479 - val_loss: 0.0543 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0541 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0471 - val_loss: 0.0542 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.1069 - val_loss: 0.1027 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1009 - val_loss: 0.0944 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0973 - val_loss: 0.0866 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0956 - val_loss: 0.0845 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0938 - val_loss: 0.0792 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0760 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0872 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0829 - val_loss: 0.0694 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0853 - val_loss: 0.0726 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0772 - val_loss: 0.0674 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0727 - val_loss: 0.0667 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0684 - val_loss: 0.0572 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0638 - val_loss: 0.0571 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0507 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0580 - val_loss: 0.0539 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0568 - val_loss: 0.0492 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0561 - val_loss: 0.0479 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0485 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0540 - val_loss: 0.0473 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0567 - val_loss: 0.0489 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0539 - val_loss: 0.0472 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0451 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0447 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0531 - val_loss: 0.0458 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0526 - val_loss: 0.0488 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0517 - val_loss: 0.0515 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0518 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0484 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0490 - val_loss: 0.0501 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0475 - val_loss: 0.0503 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0473 - val_loss: 0.0506 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0482 - val_loss: 0.0513 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0474 - val_loss: 0.0508 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0506 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0504 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0465 - val_loss: 0.0506 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0463 - val_loss: 0.0506 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0467 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0508 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0478 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 1/100
68/68 [==============================] - 5s 29ms/step - loss: 0.1249 - val_loss: 0.1007 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1044 - val_loss: 0.1013 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0985 - val_loss: 0.0958 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0963 - val_loss: 0.0976 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0912 - val_loss: 0.0925 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0863 - val_loss: 0.0905 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0855 - val_loss: 0.0883 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0786 - val_loss: 0.0810 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0739 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0695 - val_loss: 0.0823 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0670 - val_loss: 0.0822 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0654 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0631 - val_loss: 0.0744 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0708 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0587 - val_loss: 0.0688 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0582 - val_loss: 0.0672 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0573 - val_loss: 0.0665 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0543 - val_loss: 0.0682 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0530 - val_loss: 0.0653 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0523 - val_loss: 0.0650 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0516 - val_loss: 0.0677 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0659 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0498 - val_loss: 0.0664 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0508 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0501 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0597 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0495 - val_loss: 0.0565 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0483 - val_loss: 0.0555 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0484 - val_loss: 0.0546 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0481 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0536 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0473 - val_loss: 0.0535 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0459 - val_loss: 0.0534 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0533 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0533 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0462 - val_loss: 0.0532 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0453 - val_loss: 0.0532 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0466 - val_loss: 0.0532 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0532 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0532 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0465 - val_loss: 0.0532 - lr: 1.1138e-06

Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0532 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0458 - val_loss: 0.0532 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0466 - val_loss: 0.0532 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0531 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0531 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0531 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0453 - val_loss: 0.0531 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0459 - val_loss: 0.0531 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0531 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0452 - val_loss: 0.0531 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0531 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0465 - val_loss: 0.0531 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0531 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0456 - val_loss: 0.0531 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0460 - val_loss: 0.0531 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0470 - val_loss: 0.0531 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0531 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0454 - val_loss: 0.0531 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0461 - val_loss: 0.0531 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0531 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0531 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0531 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0531 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0457 - val_loss: 0.0531 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 6s 31ms/step - loss: 0.1126 - val_loss: 0.1002 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0968 - val_loss: 0.0963 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0881 - val_loss: 0.0952 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0856 - val_loss: 0.0930 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0814 - val_loss: 0.0918 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0780 - val_loss: 0.0894 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0745 - val_loss: 0.0872 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0850 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0683 - val_loss: 0.0821 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0663 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0627 - val_loss: 0.0794 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0808 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0814 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0556 - val_loss: 0.0800 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0552 - val_loss: 0.0792 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0525 - val_loss: 0.0793 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0514 - val_loss: 0.0772 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0491 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0494 - val_loss: 0.0742 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0488 - val_loss: 0.0733 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0707 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0446 - val_loss: 0.0669 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0648 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0419 - val_loss: 0.0631 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0402 - val_loss: 0.0616 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0401 - val_loss: 0.0604 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0392 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0398 - val_loss: 0.0592 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0388 - val_loss: 0.0583 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0390 - val_loss: 0.0577 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0386 - val_loss: 0.0572 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0385 - val_loss: 0.0569 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0379 - val_loss: 0.0569 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0567 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0371 - val_loss: 0.0567 - lr: 1.1109e-05

Epoch 36/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0379 - val_loss: 0.0568 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0383 - val_loss: 0.0568 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0373 - val_loss: 0.0568 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0375 - val_loss: 0.0568 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0374 - val_loss: 0.0568 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0568 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0370 - val_loss: 0.0568 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0377 - val_loss: 0.0568 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0381 - val_loss: 0.0568 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0376 - val_loss: 0.0568 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0383 - val_loss: 0.0568 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0378 - val_loss: 0.0568 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0375 - val_loss: 0.0568 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0376 - val_loss: 0.0568 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0380 - val_loss: 0.0568 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0372 - val_loss: 0.0568 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0371 - val_loss: 0.0568 - lr: 6.1442e-09
Average Validation Loss: 0.057608237862586974
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 6s 131ms/step - loss: 0.1222 - val_loss: 0.1280 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1025 - val_loss: 0.1294 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1026 - val_loss: 0.1265 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0995 - val_loss: 0.1230 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0952 - val_loss: 0.1191 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0928 - val_loss: 0.1175 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0901 - val_loss: 0.1178 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0805 - val_loss: 0.1155 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0751 - val_loss: 0.1078 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0684 - val_loss: 0.1064 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0596 - val_loss: 0.1032 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0509 - val_loss: 0.1023 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0516 - val_loss: 0.1054 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0504 - val_loss: 0.1032 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0455 - val_loss: 0.0965 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0458 - val_loss: 0.1009 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0446 - val_loss: 0.0984 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0443 - val_loss: 0.0965 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0435 - val_loss: 0.0935 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0430 - val_loss: 0.1030 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0450 - val_loss: 0.0942 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0428 - val_loss: 0.0971 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0438 - val_loss: 0.0957 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0430 - val_loss: 0.0972 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0437 - val_loss: 0.0948 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0405 - val_loss: 0.0968 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0412 - val_loss: 0.0981 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0396 - val_loss: 0.0955 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0411 - val_loss: 0.0947 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0418 - val_loss: 0.0963 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0424 - val_loss: 0.0967 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0409 - val_loss: 0.0966 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0419 - val_loss: 0.0964 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0408 - val_loss: 0.0961 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0397 - val_loss: 0.0960 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0410 - val_loss: 0.0959 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0412 - val_loss: 0.0959 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0425 - val_loss: 0.0960 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0409 - val_loss: 0.0960 - lr: 3.3460e-06
Epoch 1/100
17/17 [==============================] - 3s 64ms/step - loss: 0.1509 - val_loss: 0.0780 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1169 - val_loss: 0.0681 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1157 - val_loss: 0.0700 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1099 - val_loss: 0.0700 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1063 - val_loss: 0.0689 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1025 - val_loss: 0.0681 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0992 - val_loss: 0.0663 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0951 - val_loss: 0.0669 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0865 - val_loss: 0.0793 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0986 - val_loss: 0.0708 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0819 - val_loss: 0.0746 - lr: 9.0484e-04

Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0768 - val_loss: 0.0724 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0735 - val_loss: 0.0724 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0697 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0670 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0669 - val_loss: 0.0780 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0626 - val_loss: 0.0784 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0640 - val_loss: 0.0792 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0632 - val_loss: 0.0804 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0628 - val_loss: 0.0816 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0613 - val_loss: 0.0835 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0605 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0612 - val_loss: 0.0807 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0616 - val_loss: 0.0857 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0612 - val_loss: 0.0818 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0615 - val_loss: 0.0835 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0598 - val_loss: 0.0830 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 4s 51ms/step - loss: 0.1437 - val_loss: 0.1181 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 29ms/step - loss: 0.1000 - val_loss: 0.1055 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0956 - val_loss: 0.0962 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0938 - val_loss: 0.0938 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0884 - val_loss: 0.0881 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0861 - val_loss: 0.0816 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0847 - val_loss: 0.0803 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0823 - val_loss: 0.0768 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0750 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0734 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0681 - val_loss: 0.0667 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0630 - val_loss: 0.0616 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0591 - val_loss: 0.0623 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0604 - val_loss: 0.0628 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0616 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0684 - val_loss: 0.0578 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0621 - val_loss: 0.0534 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0559 - val_loss: 0.0539 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0558 - val_loss: 0.0532 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0573 - val_loss: 0.0499 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0553 - val_loss: 0.0483 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0530 - val_loss: 0.0480 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0501 - val_loss: 0.0478 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0498 - val_loss: 0.0473 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0482 - val_loss: 0.0473 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0473 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0471 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0476 - val_loss: 0.0470 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0475 - val_loss: 0.0470 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0473 - val_loss: 0.0470 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0482 - val_loss: 0.0470 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0491 - val_loss: 0.0470 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0462 - val_loss: 0.0470 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0472 - val_loss: 0.0470 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0476 - val_loss: 0.0470 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0479 - val_loss: 0.0470 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 40ms/step - loss: 0.0465 - val_loss: 0.0470 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0469 - val_loss: 0.0470 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0470 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0470 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0467 - val_loss: 0.0470 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0470 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0470 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0466 - val_loss: 0.0470 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0472 - val_loss: 0.0470 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0470 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0474 - val_loss: 0.0470 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0465 - val_loss: 0.0470 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0481 - val_loss: 0.0470 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0477 - val_loss: 0.0470 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0468 - val_loss: 0.0470 - lr: 1.6702e-08
Epoch 1/100
34/34 [==============================] - 5s 45ms/step - loss: 0.1115 - val_loss: 0.0981 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0964 - val_loss: 0.1020 - lr: 0.0010

Epoch 3/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0922 - val_loss: 0.1123 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0880 - val_loss: 0.1203 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0887 - val_loss: 0.1066 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0819 - val_loss: 0.1084 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0792 - val_loss: 0.1031 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0740 - val_loss: 0.0939 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0697 - val_loss: 0.0985 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0686 - val_loss: 0.0882 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0679 - val_loss: 0.0963 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0652 - val_loss: 0.0924 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0650 - val_loss: 0.1009 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0687 - val_loss: 0.1065 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0796 - val_loss: 0.0987 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0778 - val_loss: 0.0766 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0670 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0704 - val_loss: 0.0770 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0659 - val_loss: 0.0746 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0645 - val_loss: 0.0714 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0618 - val_loss: 0.0642 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0586 - val_loss: 0.0629 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0575 - val_loss: 0.0598 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0559 - val_loss: 0.0577 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0546 - val_loss: 0.0566 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0549 - val_loss: 0.0554 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0527 - val_loss: 0.0550 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0531 - val_loss: 0.0544 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0517 - val_loss: 0.0536 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0533 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0500 - val_loss: 0.0532 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0513 - val_loss: 0.0530 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0520 - val_loss: 0.0528 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0506 - val_loss: 0.0528 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0528 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0528 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0501 - val_loss: 0.0527 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0527 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0503 - val_loss: 0.0527 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0527 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0497 - val_loss: 0.0527 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0518 - val_loss: 0.0527 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0495 - val_loss: 0.0527 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0497 - val_loss: 0.0527 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0508 - val_loss: 0.0527 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0527 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0495 - val_loss: 0.0527 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0503 - val_loss: 0.0527 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0515 - val_loss: 0.0527 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0520 - val_loss: 0.0527 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0506 - val_loss: 0.0527 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0508 - val_loss: 0.0527 - lr: 1.8698e-13

Epoch 73/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0494 - val_loss: 0.0527 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0498 - val_loss: 0.0527 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0527 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0527 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0507 - val_loss: 0.0527 - lr: 5.6464e-15
Epoch 78/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0505 - val_loss: 0.0527 - lr: 2.8039e-15
Epoch 79/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 1.3924e-15
Epoch 80/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0502 - val_loss: 0.0527 - lr: 6.9144e-16
Epoch 81/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0499 - val_loss: 0.0527 - lr: 3.1068e-16
Epoch 1/100
43/43 [==============================] - 5s 36ms/step - loss: 0.1260 - val_loss: 0.1002 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1005 - val_loss: 0.0935 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0894 - val_loss: 0.0856 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0818 - val_loss: 0.0854 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0751 - val_loss: 0.0812 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0735 - val_loss: 0.0840 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0687 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0704 - val_loss: 0.0804 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0666 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0659 - val_loss: 0.0780 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0620 - val_loss: 0.0773 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0603 - val_loss: 0.0767 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0567 - val_loss: 0.0735 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0527 - val_loss: 0.0728 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0516 - val_loss: 0.0715 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0500 - val_loss: 0.0708 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0490 - val_loss: 0.0689 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0672 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0658 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0652 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0433 - val_loss: 0.0648 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0429 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0431 - val_loss: 0.0648 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0427 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0434 - val_loss: 0.0646 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0639 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0433 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0428 - val_loss: 0.0619 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0609 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0411 - val_loss: 0.0602 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0413 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0407 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0597 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0597 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0403 - val_loss: 0.0596 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0396 - val_loss: 0.0596 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0407 - val_loss: 0.0595 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 2s 48ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0404 - val_loss: 0.0595 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0403 - val_loss: 0.0595 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0398 - val_loss: 0.0595 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0409 - val_loss: 0.0595 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0400 - val_loss: 0.0595 - lr: 1.6788e-10

Epoch 62/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0400 - val_loss: 0.0595 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0595 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0408 - val_loss: 0.0595 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0405 - val_loss: 0.0595 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0407 - val_loss: 0.0595 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0404 - val_loss: 0.0595 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0402 - val_loss: 0.0595 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0406 - val_loss: 0.0595 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0410 - val_loss: 0.0595 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0401 - val_loss: 0.0595 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0398 - val_loss: 0.0595 - lr: 2.2897e-14
Average Validation Loss: 0.06376742348074912
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 217ms/step - loss: 0.1613 - val_loss: 0.1178 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0915 - val_loss: 0.1201 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0924 - val_loss: 0.1318 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0976 - val_loss: 0.1352 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0994 - val_loss: 0.1305 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0931 - val_loss: 0.1222 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0903 - val_loss: 0.1134 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0840 - val_loss: 0.1081 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0809 - val_loss: 0.1067 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0751 - val_loss: 0.1084 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0714 - val_loss: 0.1125 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0709 - val_loss: 0.1142 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0673 - val_loss: 0.1115 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0617 - val_loss: 0.1097 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0610 - val_loss: 0.1104 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0588 - val_loss: 0.1131 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0563 - val_loss: 0.1114 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0562 - val_loss: 0.1118 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0563 - val_loss: 0.1108 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0535 - val_loss: 0.1096 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0536 - val_loss: 0.1099 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0515 - val_loss: 0.1105 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0533 - val_loss: 0.1108 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0512 - val_loss: 0.1096 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0486 - val_loss: 0.1092 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0492 - val_loss: 0.1087 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0509 - val_loss: 0.1085 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 33ms/step - loss: 0.0474 - val_loss: 0.1088 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0495 - val_loss: 0.1089 - lr: 6.0810e-05
Epoch 1/100
9/9 [==============================] - 4s 119ms/step - loss: 0.2050 - val_loss: 0.1336 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1160 - val_loss: 0.0729 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1143 - val_loss: 0.0701 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1095 - val_loss: 0.0703 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1039 - val_loss: 0.0759 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1001 - val_loss: 0.0696 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0915 - val_loss: 0.0635 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0865 - val_loss: 0.0747 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0825 - val_loss: 0.0639 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0769 - val_loss: 0.0774 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0779 - val_loss: 0.0686 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0738 - val_loss: 0.0791 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0719 - val_loss: 0.0695 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0693 - val_loss: 0.0824 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0688 - val_loss: 0.0711 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0679 - val_loss: 0.0786 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0676 - val_loss: 0.0728 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0671 - val_loss: 0.0767 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0649 - val_loss: 0.0734 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0649 - val_loss: 0.0717 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0650 - val_loss: 0.0734 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0635 - val_loss: 0.0726 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0624 - val_loss: 0.0746 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0630 - val_loss: 0.0739 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0628 - val_loss: 0.0710 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0617 - val_loss: 0.0719 - lr: 1.1080e-04
Epoch 27/100

9/9 [==============================] - 0s 27ms/step - loss: 0.0624 - val_loss: 0.0744 - lr: 9.0718e-05
Epoch 1/100
13/13 [==============================] - 5s 108ms/step - loss: 0.1417 - val_loss: 0.1148 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1099 - val_loss: 0.1092 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1001 - val_loss: 0.1147 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0909 - val_loss: 0.0992 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0854 - val_loss: 0.0895 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0833 - val_loss: 0.0792 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0793 - val_loss: 0.0733 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0746 - val_loss: 0.0667 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0728 - val_loss: 0.0622 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0730 - val_loss: 0.0591 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0684 - val_loss: 0.0578 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0637 - val_loss: 0.0565 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0618 - val_loss: 0.0542 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0627 - val_loss: 0.0537 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0601 - val_loss: 0.0527 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0588 - val_loss: 0.0520 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0588 - val_loss: 0.0517 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0559 - val_loss: 0.0500 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0564 - val_loss: 0.0496 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0551 - val_loss: 0.0491 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0538 - val_loss: 0.0496 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0536 - val_loss: 0.0483 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0531 - val_loss: 0.0485 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0488 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0529 - val_loss: 0.0482 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0478 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0523 - val_loss: 0.0474 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0524 - val_loss: 0.0476 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0522 - val_loss: 0.0476 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0518 - val_loss: 0.0475 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0519 - val_loss: 0.0476 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0477 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0521 - val_loss: 0.0475 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0513 - val_loss: 0.0473 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0518 - val_loss: 0.0473 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0511 - val_loss: 0.0474 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0513 - val_loss: 0.0474 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0512 - val_loss: 0.0474 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0510 - val_loss: 0.0474 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0509 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0511 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0518 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0514 - val_loss: 0.0474 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0516 - val_loss: 0.0474 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0513 - val_loss: 0.0474 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0507 - val_loss: 0.0474 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0519 - val_loss: 0.0474 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0509 - val_loss: 0.0474 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0519 - val_loss: 0.0474 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0512 - val_loss: 0.0474 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0517 - val_loss: 0.0474 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0522 - val_loss: 0.0474 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0527 - val_loss: 0.0474 - lr: 3.7267e-09
Epoch 1/100
17/17 [==============================] - 4s 71ms/step - loss: 0.1282 - val_loss: 0.1045 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1122 - val_loss: 0.0970 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1007 - val_loss: 0.0926 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0939 - val_loss: 0.0896 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0888 - val_loss: 0.0880 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0833 - val_loss: 0.0983 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0838 - val_loss: 0.0932 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0794 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0731 - val_loss: 0.0857 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0726 - val_loss: 0.0907 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0704 - val_loss: 0.0857 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0706 - val_loss: 0.0640 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0647 - val_loss: 0.0554 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0582 - val_loss: 0.0540 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0573 - val_loss: 0.0513 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0555 - val_loss: 0.0485 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0573 - val_loss: 0.0413 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0570 - val_loss: 0.0387 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0515 - val_loss: 0.0375 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0500 - val_loss: 0.0366 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0503 - val_loss: 0.0365 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0494 - val_loss: 0.0361 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0493 - val_loss: 0.0361 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0484 - val_loss: 0.0360 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0487 - val_loss: 0.0363 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0477 - val_loss: 0.0359 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0475 - val_loss: 0.0359 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0482 - val_loss: 0.0360 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0476 - val_loss: 0.0359 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0473 - val_loss: 0.0359 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0481 - val_loss: 0.0358 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0479 - val_loss: 0.0357 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0480 - val_loss: 0.0357 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0471 - val_loss: 0.0357 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0473 - val_loss: 0.0357 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0472 - val_loss: 0.0357 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0464 - val_loss: 0.0357 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0475 - val_loss: 0.0356 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0469 - val_loss: 0.0356 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0469 - val_loss: 0.0356 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0480 - val_loss: 0.0356 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0481 - val_loss: 0.0356 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0474 - val_loss: 0.0356 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0484 - val_loss: 0.0356 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0470 - val_loss: 0.0356 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0464 - val_loss: 0.0356 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0466 - val_loss: 0.0356 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0479 - val_loss: 0.0356 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0476 - val_loss: 0.0356 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0471 - val_loss: 0.0356 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0472 - val_loss: 0.0356 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0467 - val_loss: 0.0356 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0477 - val_loss: 0.0356 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0468 - val_loss: 0.0356 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0473 - val_loss: 0.0356 - lr: 1.1370e-14
Epoch 1/100
22/22 [==============================] - 5s 59ms/step - loss: 0.1214 - val_loss: 0.1043 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1044 - val_loss: 0.1001 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0994 - val_loss: 0.1001 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0950 - val_loss: 0.1009 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0958 - val_loss: 0.1012 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0912 - val_loss: 0.0984 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0885 - val_loss: 0.0985 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0886 - val_loss: 0.1002 - lr: 0.0010

Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0889 - val_loss: 0.0989 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0827 - val_loss: 0.0958 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0803 - val_loss: 0.0970 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0813 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0779 - val_loss: 0.0945 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0733 - val_loss: 0.0942 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0720 - val_loss: 0.0922 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0698 - val_loss: 0.0927 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0661 - val_loss: 0.0906 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0639 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0614 - val_loss: 0.0893 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0601 - val_loss: 0.0889 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0596 - val_loss: 0.0879 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0575 - val_loss: 0.0848 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0543 - val_loss: 0.0839 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0537 - val_loss: 0.0829 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0519 - val_loss: 0.0812 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0513 - val_loss: 0.0808 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0512 - val_loss: 0.0803 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0496 - val_loss: 0.0794 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0502 - val_loss: 0.0791 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0503 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0497 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0493 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0493 - val_loss: 0.0785 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0486 - val_loss: 0.0783 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0480 - val_loss: 0.0784 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0491 - val_loss: 0.0782 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0484 - val_loss: 0.0782 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0487 - val_loss: 0.0782 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0492 - val_loss: 0.0782 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0492 - val_loss: 0.0782 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0496 - val_loss: 0.0782 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0487 - val_loss: 0.0782 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0488 - val_loss: 0.0782 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0485 - val_loss: 0.0782 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0495 - val_loss: 0.0782 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0494 - val_loss: 0.0782 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0485 - val_loss: 0.0782 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0496 - val_loss: 0.0782 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0490 - val_loss: 0.0782 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0782 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0493 - val_loss: 0.0782 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0489 - val_loss: 0.0782 - lr: 9.2853e-14
Average Validation Loss: 0.06628555133938789
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 71ms/step - loss: 0.1849 - val_loss: 0.1909 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1722 - val_loss: 0.1832 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1602 - val_loss: 0.1753 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1553 - val_loss: 0.1657 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1458 - val_loss: 0.1627 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1451 - val_loss: 0.1525 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1222 - val_loss: 0.1595 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1235 - val_loss: 0.1495 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1086 - val_loss: 0.1573 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1010 - val_loss: 0.1764 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1150 - val_loss: 0.1355 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1061 - val_loss: 0.1361 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0900 - val_loss: 0.1291 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0837 - val_loss: 0.1339 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0856 - val_loss: 0.1245 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0828 - val_loss: 0.1197 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0800 - val_loss: 0.1351 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0788 - val_loss: 0.1269 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0812 - val_loss: 0.1181 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0758 - val_loss: 0.1343 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0794 - val_loss: 0.1187 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0769 - val_loss: 0.1248 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0740 - val_loss: 0.1208 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0756 - val_loss: 0.1244 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0749 - val_loss: 0.1297 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0759 - val_loss: 0.1216 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0742 - val_loss: 0.1225 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1262 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0744 - val_loss: 0.1244 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0724 - val_loss: 0.1214 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1215 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0727 - val_loss: 0.1230 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0733 - val_loss: 0.1220 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0720 - val_loss: 0.1217 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0738 - val_loss: 0.1210 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0726 - val_loss: 0.1211 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0748 - val_loss: 0.1212 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0728 - val_loss: 0.1215 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0758 - val_loss: 0.1215 - lr: 3.3460e-06
Epoch 1/100
34/34 [==============================] - 4s 44ms/step - loss: 0.1915 - val_loss: 0.1349 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1733 - val_loss: 0.1274 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1638 - val_loss: 0.1170 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1528 - val_loss: 0.1126 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1500 - val_loss: 0.0995 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1413 - val_loss: 0.1073 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1379 - val_loss: 0.0904 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1322 - val_loss: 0.0972 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1251 - val_loss: 0.1011 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1286 - val_loss: 0.0853 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1158 - val_loss: 0.0993 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1106 - val_loss: 0.0976 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1103 - val_loss: 0.0864 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1060 - val_loss: 0.0898 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0999 - val_loss: 0.0887 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0946 - val_loss: 0.0907 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0953 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0900 - val_loss: 0.0851 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0858 - val_loss: 0.0858 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0833 - val_loss: 0.0813 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0813 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0795 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0764 - val_loss: 0.0780 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0751 - val_loss: 0.0781 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0748 - val_loss: 0.0777 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0732 - val_loss: 0.0784 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0718 - val_loss: 0.0780 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0706 - val_loss: 0.0786 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0705 - val_loss: 0.0786 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0710 - val_loss: 0.0776 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0721 - val_loss: 0.0785 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0700 - val_loss: 0.0797 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0694 - val_loss: 0.0796 - lr: 2.0242e-05
Epoch 34/100

34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0798 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0713 - val_loss: 0.0796 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0698 - val_loss: 0.0794 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0707 - val_loss: 0.0793 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0692 - val_loss: 0.0792 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0707 - val_loss: 0.0792 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0711 - val_loss: 0.0793 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0696 - val_loss: 0.0793 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0714 - val_loss: 0.0793 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0704 - val_loss: 0.0792 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0699 - val_loss: 0.0792 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0792 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0690 - val_loss: 0.0792 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0693 - val_loss: 0.0792 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0689 - val_loss: 0.0792 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0696 - val_loss: 0.0792 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0717 - val_loss: 0.0792 - lr: 4.5400e-08
Epoch 1/100
51/51 [==============================] - 4s 31ms/step - loss: 0.1876 - val_loss: 0.1696 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1545 - val_loss: 0.1482 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1428 - val_loss: 0.1345 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1335 - val_loss: 0.1241 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1277 - val_loss: 0.1180 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1245 - val_loss: 0.1142 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1186 - val_loss: 0.1088 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1142 - val_loss: 0.1050 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1096 - val_loss: 0.1023 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1031 - val_loss: 0.0932 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1081 - val_loss: 0.0984 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0954 - val_loss: 0.0842 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0919 - val_loss: 0.0859 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0864 - val_loss: 0.0743 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0821 - val_loss: 0.0740 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0767 - val_loss: 0.0661 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0725 - val_loss: 0.0672 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0735 - val_loss: 0.0634 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0677 - val_loss: 0.0599 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0680 - val_loss: 0.0606 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0663 - val_loss: 0.0581 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0644 - val_loss: 0.0583 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0645 - val_loss: 0.0569 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0636 - val_loss: 0.0561 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0627 - val_loss: 0.0557 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0555 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0566 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0631 - val_loss: 0.0579 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0582 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0613 - val_loss: 0.0581 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0621 - val_loss: 0.0590 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0616 - val_loss: 0.0580 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0616 - val_loss: 0.0584 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0582 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0583 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0608 - val_loss: 0.0580 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0581 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0582 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0583 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0584 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0611 - val_loss: 0.0583 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0583 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0609 - val_loss: 0.0583 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0583 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0601 - val_loss: 0.0583 - lr: 2.2487e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1862 - val_loss: 0.1522 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1497 - val_loss: 0.1438 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1384 - val_loss: 0.1340 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1297 - val_loss: 0.1232 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1234 - val_loss: 0.1173 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1183 - val_loss: 0.1120 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1122 - val_loss: 0.1046 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1089 - val_loss: 0.1027 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1028 - val_loss: 0.0971 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1023 - val_loss: 0.0972 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0947 - val_loss: 0.0898 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0895 - val_loss: 0.0925 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0859 - val_loss: 0.0841 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0803 - val_loss: 0.0839 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0759 - val_loss: 0.0881 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0770 - val_loss: 0.0795 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0753 - val_loss: 0.0774 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0699 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0694 - val_loss: 0.0707 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0684 - val_loss: 0.0689 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0660 - val_loss: 0.0667 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0647 - val_loss: 0.0651 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0641 - val_loss: 0.0639 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0645 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0641 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0590 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0621 - val_loss: 0.0563 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0551 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0613 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0611 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0610 - val_loss: 0.0530 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0605 - val_loss: 0.0530 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0593 - val_loss: 0.0530 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0597 - val_loss: 0.0529 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0598 - val_loss: 0.0529 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0588 - val_loss: 0.0529 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0599 - val_loss: 0.0529 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0605 - val_loss: 0.0529 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0592 - val_loss: 0.0528 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0603 - val_loss: 0.0528 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0592 - val_loss: 0.0528 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0598 - val_loss: 0.0528 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0598 - val_loss: 0.0528 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0607 - val_loss: 0.0528 - lr: 9.2853e-14
Epoch 1/100
85/85 [==============================] - 5s 25ms/step - loss: 0.1889 - val_loss: 0.1470 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1502 - val_loss: 0.1308 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1352 - val_loss: 0.1208 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1264 - val_loss: 0.1144 - lr: 0.0010

Epoch 5/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1202 - val_loss: 0.1084 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1143 - val_loss: 0.1027 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1127 - val_loss: 0.1009 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1090 - val_loss: 0.1021 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1046 - val_loss: 0.1015 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1007 - val_loss: 0.0933 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0949 - val_loss: 0.0890 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0916 - val_loss: 0.0874 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0878 - val_loss: 0.0837 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0824 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0815 - val_loss: 0.0802 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0774 - val_loss: 0.0787 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0748 - val_loss: 0.0778 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0739 - val_loss: 0.0762 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0719 - val_loss: 0.0755 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0708 - val_loss: 0.0735 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0670 - val_loss: 0.0721 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0657 - val_loss: 0.0705 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0625 - val_loss: 0.0698 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0693 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0611 - val_loss: 0.0688 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0601 - val_loss: 0.0699 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0596 - val_loss: 0.0703 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0590 - val_loss: 0.0706 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0692 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0591 - val_loss: 0.0691 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0691 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0680 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0675 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0569 - val_loss: 0.0672 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0670 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0571 - val_loss: 0.0666 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0567 - val_loss: 0.0665 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0665 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0563 - val_loss: 0.0664 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0575 - val_loss: 0.0664 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0576 - val_loss: 0.0664 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0562 - val_loss: 0.0664 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0664 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0664 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0569 - val_loss: 0.0664 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0664 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0565 - val_loss: 0.0664 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0664 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0664 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0567 - val_loss: 0.0664 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0564 - val_loss: 0.0664 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0664 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0664 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0569 - val_loss: 0.0664 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0570 - val_loss: 0.0664 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0664 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0664 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0664 - lr: 9.2853e-14
Average Validation Loss: 0.07409415245056153
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64

Epoch 1/100
9/9 [==============================] - 4s 120ms/step - loss: 0.2673 - val_loss: 0.2112 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1759 - val_loss: 0.1844 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1614 - val_loss: 0.1879 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1617 - val_loss: 0.1857 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1615 - val_loss: 0.1796 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1562 - val_loss: 0.1742 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1562 - val_loss: 0.1685 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1440 - val_loss: 0.1649 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1421 - val_loss: 0.1619 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1401 - val_loss: 0.1592 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1354 - val_loss: 0.1573 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1332 - val_loss: 0.1556 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1305 - val_loss: 0.1531 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1262 - val_loss: 0.1503 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1202 - val_loss: 0.1494 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1217 - val_loss: 0.1463 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1187 - val_loss: 0.1429 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1144 - val_loss: 0.1413 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1118 - val_loss: 0.1383 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1080 - val_loss: 0.1363 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1039 - val_loss: 0.1354 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1059 - val_loss: 0.1328 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1032 - val_loss: 0.1301 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0999 - val_loss: 0.1301 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0988 - val_loss: 0.1303 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0979 - val_loss: 0.1287 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0965 - val_loss: 0.1284 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0982 - val_loss: 0.1286 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0945 - val_loss: 0.1288 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0934 - val_loss: 0.1281 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0927 - val_loss: 0.1275 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0946 - val_loss: 0.1270 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0945 - val_loss: 0.1267 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0936 - val_loss: 0.1266 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0942 - val_loss: 0.1268 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0940 - val_loss: 0.1268 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0921 - val_loss: 0.1268 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0946 - val_loss: 0.1267 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0915 - val_loss: 0.1267 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0925 - val_loss: 0.1267 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0935 - val_loss: 0.1268 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0910 - val_loss: 0.1268 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0954 - val_loss: 0.1268 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0926 - val_loss: 0.1268 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0917 - val_loss: 0.1268 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0921 - val_loss: 0.1268 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0919 - val_loss: 0.1268 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0937 - val_loss: 0.1268 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.1268 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0941 - val_loss: 0.1268 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0956 - val_loss: 0.1268 - lr: 1.0130e-08
Epoch 54/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0924 - val_loss: 0.1268 - lr: 6.1442e-09
Epoch 1/100
17/17 [==============================] - 5s 135ms/step - loss: 0.2025 - val_loss: 0.1419 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1780 - val_loss: 0.1293 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1656 - val_loss: 0.1253 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1547 - val_loss: 0.1177 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1459 - val_loss: 0.1092 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1400 - val_loss: 0.1058 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1336 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1265 - val_loss: 0.0984 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1221 - val_loss: 0.0959 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1146 - val_loss: 0.0954 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1125 - val_loss: 0.0933 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1063 - val_loss: 0.0950 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1034 - val_loss: 0.0903 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0997 - val_loss: 0.0880 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0986 - val_loss: 0.0873 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0941 - val_loss: 0.0891 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.0879 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0906 - val_loss: 0.0868 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0901 - val_loss: 0.0886 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0889 - val_loss: 0.0896 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0884 - val_loss: 0.0837 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0887 - val_loss: 0.0873 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0888 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0879 - val_loss: 0.0854 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0867 - val_loss: 0.0855 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0869 - val_loss: 0.0865 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0856 - val_loss: 0.0851 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0861 - val_loss: 0.0860 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0864 - val_loss: 0.0851 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0853 - val_loss: 0.0858 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0836 - val_loss: 0.0856 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0847 - val_loss: 0.0850 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0864 - val_loss: 0.0854 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0858 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0845 - val_loss: 0.0859 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0859 - val_loss: 0.0856 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0851 - val_loss: 0.0854 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0840 - val_loss: 0.0853 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0851 - val_loss: 0.0851 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.0852 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0856 - val_loss: 0.0853 - lr: 1.6616e-06
Epoch 1/100
26/26 [==============================] - 4s 51ms/step - loss: 0.1979 - val_loss: 0.1707 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1636 - val_loss: 0.1598 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1496 - val_loss: 0.1428 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1409 - val_loss: 0.1311 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1333 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1268 - val_loss: 0.1133 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1256 - val_loss: 0.1096 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1235 - val_loss: 0.1028 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1164 - val_loss: 0.1000 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1131 - val_loss: 0.0980 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1077 - val_loss: 0.0947 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1068 - val_loss: 0.0921 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1043 - val_loss: 0.0895 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1031 - val_loss: 0.0866 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0985 - val_loss: 0.0840 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0946 - val_loss: 0.0828 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0959 - val_loss: 0.0808 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0926 - val_loss: 0.0798 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0913 - val_loss: 0.0787 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0888 - val_loss: 0.0782 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0864 - val_loss: 0.0771 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0772 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0849 - val_loss: 0.0759 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0852 - val_loss: 0.0764 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0848 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0854 - val_loss: 0.0772 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0818 - val_loss: 0.0757 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0835 - val_loss: 0.0775 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0812 - val_loss: 0.0761 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0813 - val_loss: 0.0759 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0825 - val_loss: 0.0763 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0815 - val_loss: 0.0763 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0813 - val_loss: 0.0761 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0811 - val_loss: 0.0760 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0806 - val_loss: 0.0760 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0820 - val_loss: 0.0760 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0806 - val_loss: 0.0758 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0801 - val_loss: 0.0757 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0799 - val_loss: 0.0757 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0805 - val_loss: 0.0757 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0812 - val_loss: 0.0757 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0814 - val_loss: 0.0758 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0820 - val_loss: 0.0758 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0804 - val_loss: 0.0758 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0801 - val_loss: 0.0758 - lr: 2.2487e-07

Epoch 47/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0808 - val_loss: 0.0758 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0817 - val_loss: 0.0758 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0810 - val_loss: 0.0758 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0811 - val_loss: 0.0758 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0798 - val_loss: 0.0758 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0818 - val_loss: 0.0758 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0809 - val_loss: 0.0758 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0807 - val_loss: 0.0758 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0805 - val_loss: 0.0758 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0807 - val_loss: 0.0758 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0810 - val_loss: 0.0758 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0813 - val_loss: 0.0758 - lr: 5.0435e-10
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1854 - val_loss: 0.1592 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1571 - val_loss: 0.1605 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1464 - val_loss: 0.1563 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1377 - val_loss: 0.1566 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1285 - val_loss: 0.1399 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1193 - val_loss: 0.1335 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1130 - val_loss: 0.1231 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1071 - val_loss: 0.1141 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.1042 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0973 - val_loss: 0.1032 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0909 - val_loss: 0.0971 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0889 - val_loss: 0.0922 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0878 - val_loss: 0.0986 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0857 - val_loss: 0.0956 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0815 - val_loss: 0.0941 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0813 - val_loss: 0.1026 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0812 - val_loss: 0.1014 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0812 - val_loss: 0.1039 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0834 - val_loss: 0.1083 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0875 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0885 - val_loss: 0.0851 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0848 - val_loss: 0.0738 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0795 - val_loss: 0.0726 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0780 - val_loss: 0.0698 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0763 - val_loss: 0.0692 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0752 - val_loss: 0.0678 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0740 - val_loss: 0.0676 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0671 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0739 - val_loss: 0.0669 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0725 - val_loss: 0.0666 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0734 - val_loss: 0.0663 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0662 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0717 - val_loss: 0.0659 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0707 - val_loss: 0.0659 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0659 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0717 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0719 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0710 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0658 - lr: 1.3710e-09

Epoch 58/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0724 - val_loss: 0.0658 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 9.2136e-11
Epoch 1/100
43/43 [==============================] - 5s 38ms/step - loss: 0.1839 - val_loss: 0.1556 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1573 - val_loss: 0.1437 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1448 - val_loss: 0.1298 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1324 - val_loss: 0.1192 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1205 - val_loss: 0.1094 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1140 - val_loss: 0.1038 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1079 - val_loss: 0.1004 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1049 - val_loss: 0.0967 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1011 - val_loss: 0.0932 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0975 - val_loss: 0.0905 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0942 - val_loss: 0.0875 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0884 - val_loss: 0.0841 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0848 - val_loss: 0.0823 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0829 - val_loss: 0.0795 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0786 - val_loss: 0.0784 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0773 - val_loss: 0.0761 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0749 - val_loss: 0.0734 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0725 - val_loss: 0.0723 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0714 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0706 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0685 - val_loss: 0.0668 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0656 - val_loss: 0.0658 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0638 - val_loss: 0.0643 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0640 - val_loss: 0.0631 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0628 - val_loss: 0.0630 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0624 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0633 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0625 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0612 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0623 - val_loss: 0.0604 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0627 - val_loss: 0.0603 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0620 - val_loss: 0.0600 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0600 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0614 - val_loss: 0.0600 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0600 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0600 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0599 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0600 - val_loss: 0.0599 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0611 - val_loss: 0.0599 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0601 - val_loss: 0.0599 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0599 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0599 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0599 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0603 - val_loss: 0.0599 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0599 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0609 - val_loss: 0.0599 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0602 - val_loss: 0.0599 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0597 - val_loss: 0.0599 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0604 - val_loss: 0.0599 - lr: 8.3153e-10
Average Validation Loss: 0.08233513757586479
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 219ms/step - loss: 0.2372 - val_loss: 0.2114 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1831 - val_loss: 0.1905 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1665 - val_loss: 0.1943 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1701 - val_loss: 0.1969 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1702 - val_loss: 0.1957 - lr: 0.0010
Epoch 6/100

5/5 [==============================] - 0s 36ms/step - loss: 0.1685 - val_loss: 0.1914 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1655 - val_loss: 0.1855 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1622 - val_loss: 0.1798 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1565 - val_loss: 0.1758 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1507 - val_loss: 0.1748 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1508 - val_loss: 0.1745 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1459 - val_loss: 0.1747 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1426 - val_loss: 0.1742 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1419 - val_loss: 0.1728 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1403 - val_loss: 0.1703 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1364 - val_loss: 0.1681 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1370 - val_loss: 0.1663 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1325 - val_loss: 0.1662 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1313 - val_loss: 0.1660 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1320 - val_loss: 0.1646 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1264 - val_loss: 0.1629 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1261 - val_loss: 0.1618 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1254 - val_loss: 0.1610 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1204 - val_loss: 0.1605 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1224 - val_loss: 0.1602 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1232 - val_loss: 0.1596 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1214 - val_loss: 0.1594 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1194 - val_loss: 0.1591 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1191 - val_loss: 0.1587 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1178 - val_loss: 0.1583 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1172 - val_loss: 0.1580 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1207 - val_loss: 0.1578 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1225 - val_loss: 0.1576 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1168 - val_loss: 0.1575 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1188 - val_loss: 0.1575 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1165 - val_loss: 0.1575 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1192 - val_loss: 0.1575 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1182 - val_loss: 0.1574 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1205 - val_loss: 0.1574 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1179 - val_loss: 0.1574 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1168 - val_loss: 0.1574 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1179 - val_loss: 0.1574 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1193 - val_loss: 0.1574 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1166 - val_loss: 0.1574 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1209 - val_loss: 0.1574 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1153 - val_loss: 0.1574 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1211 - val_loss: 0.1574 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1199 - val_loss: 0.1574 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1201 - val_loss: 0.1574 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1219 - val_loss: 0.1574 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1203 - val_loss: 0.1574 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1152 - val_loss: 0.1574 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1219 - val_loss: 0.1574 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1203 - val_loss: 0.1574 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1212 - val_loss: 0.1574 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1181 - val_loss: 0.1574 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1174 - val_loss: 0.1574 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1194 - val_loss: 0.1574 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1201 - val_loss: 0.1574 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1187 - val_loss: 0.1574 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1182 - val_loss: 0.1574 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1196 - val_loss: 0.1574 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1190 - val_loss: 0.1574 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1180 - val_loss: 0.1574 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1207 - val_loss: 0.1574 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1189 - val_loss: 0.1574 - lr: 9.2853e-14
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.2188 - val_loss: 0.1440 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1806 - val_loss: 0.1342 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1772 - val_loss: 0.1301 - lr: 0.0010
Epoch 4/100

9/9 [==============================] - 0s 27ms/step - loss: 0.1659 - val_loss: 0.1408 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1601 - val_loss: 0.1273 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1529 - val_loss: 0.1192 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1431 - val_loss: 0.1241 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1378 - val_loss: 0.1183 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1348 - val_loss: 0.1230 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1283 - val_loss: 0.1215 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1232 - val_loss: 0.1155 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1211 - val_loss: 0.1271 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1177 - val_loss: 0.1234 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1150 - val_loss: 0.1198 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1133 - val_loss: 0.1158 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1128 - val_loss: 0.1213 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1094 - val_loss: 0.1163 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1074 - val_loss: 0.1141 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1057 - val_loss: 0.1155 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1037 - val_loss: 0.1134 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1046 - val_loss: 0.1205 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1036 - val_loss: 0.1120 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1044 - val_loss: 0.1164 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1039 - val_loss: 0.1135 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1039 - val_loss: 0.1119 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1034 - val_loss: 0.1168 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1014 - val_loss: 0.1159 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0995 - val_loss: 0.1148 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1020 - val_loss: 0.1148 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1026 - val_loss: 0.1123 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1018 - val_loss: 0.1109 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1007 - val_loss: 0.1114 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1008 - val_loss: 0.1118 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1024 - val_loss: 0.1124 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1009 - val_loss: 0.1130 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1016 - val_loss: 0.1133 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1018 - val_loss: 0.1135 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1034 - val_loss: 0.1135 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0985 - val_loss: 0.1135 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1019 - val_loss: 0.1135 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0999 - val_loss: 0.1135 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1009 - val_loss: 0.1135 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1000 - val_loss: 0.1135 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1012 - val_loss: 0.1135 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1006 - val_loss: 0.1135 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1021 - val_loss: 0.1135 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1013 - val_loss: 0.1135 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1001 - val_loss: 0.1135 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1019 - val_loss: 0.1135 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1015 - val_loss: 0.1135 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1011 - val_loss: 0.1135 - lr: 2.7536e-08
Epoch 1/100
13/13 [==============================] - 5s 93ms/step - loss: 0.2847 - val_loss: 0.2311 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1791 - val_loss: 0.1786 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1701 - val_loss: 0.1724 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1591 - val_loss: 0.1648 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1467 - val_loss: 0.1502 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1439 - val_loss: 0.1411 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1352 - val_loss: 0.1325 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1315 - val_loss: 0.1250 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1267 - val_loss: 0.1226 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1171 - val_loss: 0.1129 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1149 - val_loss: 0.1098 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1104 - val_loss: 0.1060 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 27ms/step - loss: 0.1083 - val_loss: 0.1022 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1033 - val_loss: 0.1019 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 27ms/step - loss: 0.1024 - val_loss: 0.1024 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0992 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0969 - val_loss: 0.0995 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0950 - val_loss: 0.0928 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0933 - val_loss: 0.0891 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0924 - val_loss: 0.0893 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0932 - val_loss: 0.0895 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0902 - val_loss: 0.0840 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0894 - val_loss: 0.0862 - lr: 2.0190e-04
Epoch 24/100

13/13 [==============================] - 0s 25ms/step - loss: 0.0885 - val_loss: 0.0841 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0890 - val_loss: 0.0850 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0886 - val_loss: 0.0843 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0883 - val_loss: 0.0866 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0875 - val_loss: 0.0836 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0872 - val_loss: 0.0850 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0896 - val_loss: 0.0852 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0849 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0880 - val_loss: 0.0836 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0843 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0848 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0874 - val_loss: 0.0846 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0844 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0884 - val_loss: 0.0844 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0879 - val_loss: 0.0843 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0843 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0843 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0843 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0868 - val_loss: 0.0843 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0868 - val_loss: 0.0843 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0843 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0863 - val_loss: 0.0843 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 50ms/step - loss: 0.0862 - val_loss: 0.0842 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0868 - val_loss: 0.0842 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0867 - val_loss: 0.0842 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0865 - val_loss: 0.0842 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0842 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0856 - val_loss: 0.0842 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0865 - val_loss: 0.0842 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 5s 75ms/step - loss: 0.2000 - val_loss: 0.1648 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1709 - val_loss: 0.1507 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1544 - val_loss: 0.1443 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1449 - val_loss: 0.1356 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1346 - val_loss: 0.1520 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1344 - val_loss: 0.1392 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1289 - val_loss: 0.1218 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1177 - val_loss: 0.1218 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1150 - val_loss: 0.1387 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1191 - val_loss: 0.1227 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1137 - val_loss: 0.1040 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1031 - val_loss: 0.1096 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1032 - val_loss: 0.1154 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1046 - val_loss: 0.1014 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0980 - val_loss: 0.0998 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0957 - val_loss: 0.0977 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0954 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0946 - val_loss: 0.0906 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0914 - val_loss: 0.0876 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0883 - val_loss: 0.0890 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0834 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0859 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0858 - val_loss: 0.0816 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0852 - val_loss: 0.0805 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0853 - val_loss: 0.0791 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0841 - val_loss: 0.0789 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0837 - val_loss: 0.0791 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0837 - val_loss: 0.0781 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0784 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0834 - val_loss: 0.0778 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0775 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0775 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0814 - val_loss: 0.0775 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0818 - val_loss: 0.0773 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0835 - val_loss: 0.0772 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0772 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0820 - val_loss: 0.0772 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0818 - val_loss: 0.0772 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0808 - val_loss: 0.0772 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0830 - val_loss: 0.0772 - lr: 1.6616e-06

Epoch 42/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0827 - val_loss: 0.0772 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0825 - val_loss: 0.0772 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0817 - val_loss: 0.0772 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0827 - val_loss: 0.0772 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0819 - val_loss: 0.0772 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0836 - val_loss: 0.0772 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0817 - val_loss: 0.0772 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0772 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.0772 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0822 - val_loss: 0.0772 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0821 - val_loss: 0.0772 - lr: 8.3153e-10
Epoch 1/100
22/22 [==============================] - 4s 59ms/step - loss: 0.1938 - val_loss: 0.1620 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1677 - val_loss: 0.1508 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1512 - val_loss: 0.1447 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1421 - val_loss: 0.1388 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1366 - val_loss: 0.1341 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1313 - val_loss: 0.1307 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1256 - val_loss: 0.1263 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1211 - val_loss: 0.1244 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1180 - val_loss: 0.1204 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1141 - val_loss: 0.1169 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1093 - val_loss: 0.1142 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1071 - val_loss: 0.1134 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1018 - val_loss: 0.1079 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0993 - val_loss: 0.1075 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0987 - val_loss: 0.1065 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0963 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0934 - val_loss: 0.1023 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0913 - val_loss: 0.1008 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0890 - val_loss: 0.0963 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0871 - val_loss: 0.0941 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0852 - val_loss: 0.0938 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0838 - val_loss: 0.0901 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0810 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0802 - val_loss: 0.0875 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0790 - val_loss: 0.0864 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0793 - val_loss: 0.0859 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0782 - val_loss: 0.0848 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0775 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0781 - val_loss: 0.0842 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0783 - val_loss: 0.0841 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0771 - val_loss: 0.0838 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0778 - val_loss: 0.0838 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0765 - val_loss: 0.0836 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0774 - val_loss: 0.0836 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0835 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0835 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0771 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0762 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0779 - val_loss: 0.0834 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0756 - val_loss: 0.0834 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0771 - val_loss: 0.0834 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0769 - val_loss: 0.0834 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0763 - val_loss: 0.0834 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0765 - val_loss: 0.0834 - lr: 1.0130e-08

Epoch 54/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0754 - val_loss: 0.0834 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0766 - val_loss: 0.0834 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0776 - val_loss: 0.0834 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0772 - val_loss: 0.0834 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0760 - val_loss: 0.0834 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0761 - val_loss: 0.0834 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0775 - val_loss: 0.0834 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0777 - val_loss: 0.0834 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0778 - val_loss: 0.0834 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0770 - val_loss: 0.0834 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0763 - val_loss: 0.0834 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0767 - val_loss: 0.0834 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0834 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0765 - val_loss: 0.0834 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0834 - lr: 2.2897e-14
Average Validation Loss: 0.10248724967241288
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 72ms/step - loss: 0.1692 - val_loss: 0.1775 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1595 - val_loss: 0.1691 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1505 - val_loss: 0.1601 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1459 - val_loss: 0.1586 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1391 - val_loss: 0.1546 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1348 - val_loss: 0.1466 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1292 - val_loss: 0.1442 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1228 - val_loss: 0.1402 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1210 - val_loss: 0.1404 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1158 - val_loss: 0.1338 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1090 - val_loss: 0.1318 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1064 - val_loss: 0.1291 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.1047 - val_loss: 0.1261 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0993 - val_loss: 0.1239 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0927 - val_loss: 0.1291 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0996 - val_loss: 0.1201 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0861 - val_loss: 0.1235 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0874 - val_loss: 0.1182 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0809 - val_loss: 0.1177 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0806 - val_loss: 0.1176 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0800 - val_loss: 0.1141 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0778 - val_loss: 0.1144 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0776 - val_loss: 0.1157 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0763 - val_loss: 0.1116 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0767 - val_loss: 0.1135 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0752 - val_loss: 0.1144 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0751 - val_loss: 0.1113 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0716 - val_loss: 0.1130 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0741 - val_loss: 0.1125 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0713 - val_loss: 0.1111 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0710 - val_loss: 0.1119 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0738 - val_loss: 0.1118 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0730 - val_loss: 0.1111 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0734 - val_loss: 0.1109 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0731 - val_loss: 0.1111 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0756 - val_loss: 0.1113 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0710 - val_loss: 0.1116 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0712 - val_loss: 0.1118 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0715 - val_loss: 0.1119 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0701 - val_loss: 0.1118 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0719 - val_loss: 0.1118 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0735 - val_loss: 0.1119 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0735 - val_loss: 0.1119 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0729 - val_loss: 0.1119 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 2.2487e-07

Epoch 47/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0723 - val_loss: 0.1119 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0734 - val_loss: 0.1119 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0730 - val_loss: 0.1119 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0731 - val_loss: 0.1119 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0731 - val_loss: 0.1119 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0742 - val_loss: 0.1119 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0718 - val_loss: 0.1119 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0722 - val_loss: 0.1119 - lr: 6.1442e-09
Epoch 1/100
34/34 [==============================] - 5s 53ms/step - loss: 0.1896 - val_loss: 0.1212 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1749 - val_loss: 0.1152 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1619 - val_loss: 0.1156 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1576 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1503 - val_loss: 0.1010 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1414 - val_loss: 0.0994 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1381 - val_loss: 0.1098 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1317 - val_loss: 0.0910 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1254 - val_loss: 0.1171 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1182 - val_loss: 0.1050 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1187 - val_loss: 0.0951 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1105 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1072 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1028 - val_loss: 0.1002 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0969 - val_loss: 0.1043 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0919 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0874 - val_loss: 0.0988 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0868 - val_loss: 0.0963 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0845 - val_loss: 0.0918 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0835 - val_loss: 0.0879 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0802 - val_loss: 0.0895 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0792 - val_loss: 0.0892 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0768 - val_loss: 0.0882 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0757 - val_loss: 0.0900 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0744 - val_loss: 0.0922 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0735 - val_loss: 0.0898 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0728 - val_loss: 0.0904 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0734 - val_loss: 0.0916 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0725 - val_loss: 0.0920 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0730 - val_loss: 0.0897 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0712 - val_loss: 0.0893 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0721 - val_loss: 0.0905 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0698 - val_loss: 0.0911 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0727 - val_loss: 0.0910 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0719 - val_loss: 0.0911 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0706 - val_loss: 0.0906 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0703 - val_loss: 0.0903 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0731 - val_loss: 0.0903 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0712 - val_loss: 0.0903 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0722 - val_loss: 0.0904 - lr: 2.4788e-06
Epoch 1/100
51/51 [==============================] - 5s 32ms/step - loss: 0.1659 - val_loss: 0.1581 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1459 - val_loss: 0.1431 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1376 - val_loss: 0.1299 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1301 - val_loss: 0.1208 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1254 - val_loss: 0.1157 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1201 - val_loss: 0.1099 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1156 - val_loss: 0.1048 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1119 - val_loss: 0.1029 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1086 - val_loss: 0.0964 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1034 - val_loss: 0.0966 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0980 - val_loss: 0.0869 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0926 - val_loss: 0.0870 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0830 - val_loss: 0.0731 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0767 - val_loss: 0.0696 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0747 - val_loss: 0.0680 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0717 - val_loss: 0.0663 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0680 - val_loss: 0.0641 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0686 - val_loss: 0.0642 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0678 - val_loss: 0.0626 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0657 - val_loss: 0.0631 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0669 - val_loss: 0.0619 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0658 - val_loss: 0.0620 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0616 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0673 - val_loss: 0.0632 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0652 - val_loss: 0.0640 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0656 - val_loss: 0.0648 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0641 - val_loss: 0.0655 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0633 - val_loss: 0.0657 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0623 - val_loss: 0.0650 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0619 - val_loss: 0.0662 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0660 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0623 - val_loss: 0.0666 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0667 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0666 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0667 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0666 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0664 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0665 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0613 - val_loss: 0.0665 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0615 - val_loss: 0.0665 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0616 - val_loss: 0.0665 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0665 - lr: 5.0045e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1680 - val_loss: 0.1571 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1499 - val_loss: 0.1381 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1345 - val_loss: 0.1331 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1236 - val_loss: 0.1278 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1181 - val_loss: 0.1106 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1097 - val_loss: 0.1003 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1052 - val_loss: 0.0994 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1062 - val_loss: 0.1017 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1011 - val_loss: 0.0916 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0939 - val_loss: 0.0955 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0880 - val_loss: 0.0878 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0835 - val_loss: 0.0881 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0784 - val_loss: 0.0956 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0770 - val_loss: 0.0917 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0747 - val_loss: 0.0826 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0730 - val_loss: 0.0766 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0702 - val_loss: 0.0752 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0702 - val_loss: 0.0676 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0669 - val_loss: 0.0669 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0665 - val_loss: 0.0659 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0646 - val_loss: 0.0653 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0656 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0630 - val_loss: 0.0649 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0620 - val_loss: 0.0647 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0609 - val_loss: 0.0668 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0612 - val_loss: 0.0626 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0616 - val_loss: 0.0622 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0600 - val_loss: 0.0603 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0585 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0592 - val_loss: 0.0579 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0588 - val_loss: 0.0569 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0567 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0566 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0587 - val_loss: 0.0565 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0582 - val_loss: 0.0565 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0564 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0564 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0570 - val_loss: 0.0564 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0563 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0584 - val_loss: 0.0563 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0571 - val_loss: 0.0563 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.0104e-07

Epoch 49/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0563 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0583 - val_loss: 0.0563 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0579 - val_loss: 0.0563 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0581 - val_loss: 0.0563 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0563 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0563 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0574 - val_loss: 0.0563 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0585 - val_loss: 0.0563 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0586 - val_loss: 0.0563 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0580 - val_loss: 0.0563 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0573 - val_loss: 0.0563 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0563 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0563 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0563 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0576 - val_loss: 0.0563 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0563 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 5s 25ms/step - loss: 0.1625 - val_loss: 0.1370 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 18ms/step - loss: 0.1385 - val_loss: 0.1216 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 19ms/step - loss: 0.1231 - val_loss: 0.1127 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1117 - val_loss: 0.1046 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1043 - val_loss: 0.1006 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1024 - val_loss: 0.0990 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1039 - val_loss: 0.0968 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0884 - val_loss: 0.0948 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0889 - val_loss: 0.0923 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0826 - val_loss: 0.0919 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0796 - val_loss: 0.0824 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0755 - val_loss: 0.0778 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0739 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0744 - val_loss: 0.0736 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0722 - val_loss: 0.0724 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0692 - val_loss: 0.0736 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0687 - val_loss: 0.0720 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0643 - val_loss: 0.0714 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0646 - val_loss: 0.0689 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0621 - val_loss: 0.0672 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0664 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0581 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0550 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0539 - val_loss: 0.0649 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0529 - val_loss: 0.0624 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0534 - val_loss: 0.0638 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0514 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0643 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0631 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0509 - val_loss: 0.0631 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0515 - val_loss: 0.0631 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0512 - val_loss: 0.0629 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0625 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0627 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0515 - val_loss: 0.0627 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0627 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0626 - lr: 1.6616e-06

Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0626 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0626 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0502 - val_loss: 0.0626 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0500 - val_loss: 0.0626 - lr: 2.2487e-07
Average Validation Loss: 0.07583767175674438
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 120ms/step - loss: 0.1663 - val_loss: 0.1664 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1536 - val_loss: 0.1838 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1567 - val_loss: 0.1699 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1492 - val_loss: 0.1582 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1428 - val_loss: 0.1572 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1377 - val_loss: 0.1575 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1341 - val_loss: 0.1545 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1363 - val_loss: 0.1438 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1242 - val_loss: 0.1404 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1159 - val_loss: 0.1452 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1175 - val_loss: 0.1323 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1048 - val_loss: 0.1348 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1028 - val_loss: 0.1271 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0956 - val_loss: 0.1433 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.1235 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0903 - val_loss: 0.1387 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0904 - val_loss: 0.1216 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0840 - val_loss: 0.1431 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0860 - val_loss: 0.1222 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.1360 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0849 - val_loss: 0.1235 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0826 - val_loss: 0.1305 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0827 - val_loss: 0.1268 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0812 - val_loss: 0.1265 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0828 - val_loss: 0.1236 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0808 - val_loss: 0.1243 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0797 - val_loss: 0.1250 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0814 - val_loss: 0.1276 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0816 - val_loss: 0.1276 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0819 - val_loss: 0.1258 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0818 - val_loss: 0.1254 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0809 - val_loss: 0.1252 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0820 - val_loss: 0.1250 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0808 - val_loss: 0.1252 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0807 - val_loss: 0.1257 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0818 - val_loss: 0.1257 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0820 - val_loss: 0.1255 - lr: 6.0967e-06
Epoch 1/100
17/17 [==============================] - 4s 66ms/step - loss: 0.1867 - val_loss: 0.1318 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1689 - val_loss: 0.1260 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1615 - val_loss: 0.1231 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1567 - val_loss: 0.1175 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1478 - val_loss: 0.1107 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1404 - val_loss: 0.1053 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1300 - val_loss: 0.1015 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1291 - val_loss: 0.0948 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1272 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1137 - val_loss: 0.0922 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1067 - val_loss: 0.0938 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1017 - val_loss: 0.0905 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0968 - val_loss: 0.0909 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0947 - val_loss: 0.0940 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0911 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0884 - val_loss: 0.0882 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0876 - val_loss: 0.0916 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.0861 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0847 - val_loss: 0.0888 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0838 - val_loss: 0.0913 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0839 - val_loss: 0.0881 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0828 - val_loss: 0.0908 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0806 - val_loss: 0.0885 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0813 - val_loss: 0.0915 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0814 - val_loss: 0.0887 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0798 - val_loss: 0.0866 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0787 - val_loss: 0.0898 - lr: 9.0718e-05

Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0806 - val_loss: 0.0891 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0794 - val_loss: 0.0878 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0804 - val_loss: 0.0898 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0797 - val_loss: 0.0886 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0792 - val_loss: 0.0899 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0804 - val_loss: 0.0900 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0797 - val_loss: 0.0896 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0789 - val_loss: 0.0896 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0783 - val_loss: 0.0895 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0795 - val_loss: 0.0893 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0792 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 1/100
26/26 [==============================] - 5s 69ms/step - loss: 0.1842 - val_loss: 0.1631 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1530 - val_loss: 0.1570 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1434 - val_loss: 0.1426 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1361 - val_loss: 0.1303 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1305 - val_loss: 0.1185 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1249 - val_loss: 0.1115 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1176 - val_loss: 0.1097 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1127 - val_loss: 0.1070 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1086 - val_loss: 0.1028 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 26ms/step - loss: 0.1057 - val_loss: 0.0969 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0990 - val_loss: 0.0942 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0948 - val_loss: 0.0875 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0907 - val_loss: 0.0883 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0895 - val_loss: 0.0852 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0871 - val_loss: 0.0826 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0861 - val_loss: 0.0814 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0873 - val_loss: 0.0793 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0765 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0907 - val_loss: 0.0816 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0865 - val_loss: 0.0863 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0824 - val_loss: 0.0834 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0818 - val_loss: 0.0826 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0798 - val_loss: 0.0807 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0779 - val_loss: 0.0774 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0786 - val_loss: 0.0803 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0763 - val_loss: 0.0777 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0760 - val_loss: 0.0776 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0749 - val_loss: 0.0771 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0750 - val_loss: 0.0773 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0760 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0763 - val_loss: 0.0763 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0740 - val_loss: 0.0766 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0766 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0757 - val_loss: 0.0767 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0758 - val_loss: 0.0769 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0744 - val_loss: 0.0768 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0747 - val_loss: 0.0767 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0755 - val_loss: 0.0766 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0747 - val_loss: 0.0766 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0759 - val_loss: 0.0766 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0746 - val_loss: 0.0767 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0748 - val_loss: 0.0766 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0750 - val_loss: 0.0767 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0761 - val_loss: 0.0767 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0736 - val_loss: 0.0767 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0750 - val_loss: 0.0766 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0754 - val_loss: 0.0766 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0759 - val_loss: 0.0766 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0749 - val_loss: 0.0766 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0766 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1951 - val_loss: 0.1562 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1581 - val_loss: 0.1434 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1410 - val_loss: 0.1453 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1317 - val_loss: 0.1418 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1240 - val_loss: 0.1275 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1159 - val_loss: 0.1167 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1073 - val_loss: 0.1104 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1015 - val_loss: 0.0986 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0953 - val_loss: 0.0960 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0949 - val_loss: 0.0873 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0908 - val_loss: 0.0873 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0883 - val_loss: 0.0844 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0833 - val_loss: 0.0866 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0811 - val_loss: 0.0810 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0813 - val_loss: 0.0827 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0802 - val_loss: 0.0887 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0790 - val_loss: 0.0828 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0774 - val_loss: 0.0864 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0779 - val_loss: 0.0924 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0775 - val_loss: 0.0917 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0783 - val_loss: 0.0966 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0838 - val_loss: 0.0935 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0856 - val_loss: 0.0770 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0790 - val_loss: 0.0715 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0746 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0742 - val_loss: 0.0658 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0656 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0719 - val_loss: 0.0629 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0699 - val_loss: 0.0632 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0707 - val_loss: 0.0632 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0699 - val_loss: 0.0625 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0710 - val_loss: 0.0617 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0621 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0692 - val_loss: 0.0621 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0695 - val_loss: 0.0620 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0695 - val_loss: 0.0619 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0688 - val_loss: 0.0619 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0693 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0703 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0692 - val_loss: 0.0618 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0681 - val_loss: 0.0618 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0699 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0703 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0694 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0689 - val_loss: 0.0618 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0697 - val_loss: 0.0618 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0692 - val_loss: 0.0618 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0698 - val_loss: 0.0618 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0690 - val_loss: 0.0618 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0704 - val_loss: 0.0618 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0689 - val_loss: 0.0618 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0699 - val_loss: 0.0618 - lr: 1.6702e-08
Epoch 1/100
43/43 [==============================] - 4s 39ms/step - loss: 0.1692 - val_loss: 0.1486 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 22ms/step - loss: 0.1462 - val_loss: 0.1344 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1325 - val_loss: 0.1252 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1192 - val_loss: 0.1162 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1112 - val_loss: 0.1107 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1036 - val_loss: 0.1057 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0975 - val_loss: 0.1026 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0931 - val_loss: 0.0972 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0861 - val_loss: 0.0949 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0839 - val_loss: 0.0940 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0812 - val_loss: 0.0979 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0854 - val_loss: 0.0884 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0789 - val_loss: 0.0844 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0761 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0730 - val_loss: 0.0803 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0685 - val_loss: 0.0777 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0674 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0746 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0651 - val_loss: 0.0728 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0633 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0618 - val_loss: 0.0712 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0618 - val_loss: 0.0716 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0613 - val_loss: 0.0710 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0602 - val_loss: 0.0697 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0605 - val_loss: 0.0700 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0603 - val_loss: 0.0692 - lr: 1.1080e-04
Epoch 27/100

43/43 [==============================] - 1s 22ms/step - loss: 0.0597 - val_loss: 0.0687 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0606 - val_loss: 0.0682 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0608 - val_loss: 0.0674 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0670 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0666 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0663 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0582 - val_loss: 0.0663 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0590 - val_loss: 0.0661 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0661 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0584 - val_loss: 0.0661 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0588 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0585 - val_loss: 0.0660 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0579 - val_loss: 0.0660 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0590 - val_loss: 0.0659 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0659 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0577 - val_loss: 0.0659 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0588 - val_loss: 0.0659 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0576 - val_loss: 0.0659 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0575 - val_loss: 0.0659 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0659 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0579 - val_loss: 0.0659 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0576 - val_loss: 0.0659 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0578 - val_loss: 0.0659 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0587 - val_loss: 0.0659 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0659 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0578 - val_loss: 0.0659 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0584 - val_loss: 0.0659 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0582 - val_loss: 0.0659 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0659 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0586 - val_loss: 0.0659 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0581 - val_loss: 0.0659 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0573 - val_loss: 0.0659 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0583 - val_loss: 0.0659 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0582 - val_loss: 0.0659 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0585 - val_loss: 0.0659 - lr: 9.2853e-14
Average Validation Loss: 0.0822853147983551
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 229ms/step - loss: 0.2118 - val_loss: 0.1796 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1614 - val_loss: 0.1842 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1666 - val_loss: 0.1920 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1676 - val_loss: 0.1922 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1638 - val_loss: 0.1866 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1606 - val_loss: 0.1794 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1541 - val_loss: 0.1733 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1497 - val_loss: 0.1688 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1467 - val_loss: 0.1656 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1437 - val_loss: 0.1631 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1364 - val_loss: 0.1622 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1332 - val_loss: 0.1605 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1349 - val_loss: 0.1575 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1301 - val_loss: 0.1539 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1318 - val_loss: 0.1512 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1242 - val_loss: 0.1500 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1239 - val_loss: 0.1486 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1209 - val_loss: 0.1468 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1176 - val_loss: 0.1438 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1157 - val_loss: 0.1415 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1154 - val_loss: 0.1409 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1143 - val_loss: 0.1398 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1110 - val_loss: 0.1391 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1144 - val_loss: 0.1383 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1069 - val_loss: 0.1378 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1081 - val_loss: 0.1376 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1062 - val_loss: 0.1376 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1120 - val_loss: 0.1377 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1099 - val_loss: 0.1376 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1092 - val_loss: 0.1372 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1037 - val_loss: 0.1368 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1078 - val_loss: 0.1366 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1118 - val_loss: 0.1364 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1078 - val_loss: 0.1363 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1069 - val_loss: 0.1362 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1071 - val_loss: 0.1362 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1070 - val_loss: 0.1361 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1060 - val_loss: 0.1361 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1073 - val_loss: 0.1361 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1061 - val_loss: 0.1361 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1101 - val_loss: 0.1361 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1045 - val_loss: 0.1361 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1080 - val_loss: 0.1361 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1074 - val_loss: 0.1361 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1074 - val_loss: 0.1361 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1072 - val_loss: 0.1361 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1056 - val_loss: 0.1361 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1046 - val_loss: 0.1361 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1073 - val_loss: 0.1361 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1091 - val_loss: 0.1361 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1090 - val_loss: 0.1361 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1064 - val_loss: 0.1361 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1068 - val_loss: 0.1361 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1067 - val_loss: 0.1361 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1076 - val_loss: 0.1361 - lr: 5.0435e-10
Epoch 60/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1092 - val_loss: 0.1361 - lr: 3.0590e-10
Epoch 61/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1078 - val_loss: 0.1361 - lr: 1.6788e-10
Epoch 62/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1079 - val_loss: 0.1361 - lr: 9.2136e-11
Epoch 63/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1038 - val_loss: 0.1361 - lr: 5.0565e-11
Epoch 64/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 2.7751e-11
Epoch 65/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1095 - val_loss: 0.1361 - lr: 1.5230e-11
Epoch 66/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 8.3584e-12
Epoch 67/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1087 - val_loss: 0.1361 - lr: 4.5872e-12
Epoch 68/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1083 - val_loss: 0.1361 - lr: 2.5175e-12
Epoch 69/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1082 - val_loss: 0.1361 - lr: 1.3816e-12
Epoch 70/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1097 - val_loss: 0.1361 - lr: 7.5826e-13
Epoch 71/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1071 - val_loss: 0.1361 - lr: 3.7654e-13
Epoch 72/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1092 - val_loss: 0.1361 - lr: 1.8698e-13
Epoch 73/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1063 - val_loss: 0.1361 - lr: 9.2853e-14
Epoch 74/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1091 - val_loss: 0.1361 - lr: 4.6110e-14
Epoch 75/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1066 - val_loss: 0.1361 - lr: 2.2897e-14
Epoch 1/100
9/9 [==============================] - 4s 126ms/step - loss: 0.1895 - val_loss: 0.1315 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1770 - val_loss: 0.1262 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1698 - val_loss: 0.1255 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1603 - val_loss: 0.1220 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1572 - val_loss: 0.1172 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1519 - val_loss: 0.1138 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1442 - val_loss: 0.1216 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1385 - val_loss: 0.1111 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1326 - val_loss: 0.1350 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1272 - val_loss: 0.1205 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1234 - val_loss: 0.1237 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 53ms/step - loss: 0.1166 - val_loss: 0.1223 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1153 - val_loss: 0.1256 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1119 - val_loss: 0.1228 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1102 - val_loss: 0.1194 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1081 - val_loss: 0.1184 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1069 - val_loss: 0.1189 - lr: 4.9659e-04
Epoch 18/100

9/9 [==============================] - 0s 27ms/step - loss: 0.1042 - val_loss: 0.1162 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1035 - val_loss: 0.1142 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1043 - val_loss: 0.1170 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1035 - val_loss: 0.1119 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1011 - val_loss: 0.1131 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0995 - val_loss: 0.1144 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1001 - val_loss: 0.1121 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0998 - val_loss: 0.1101 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1002 - val_loss: 0.1101 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0980 - val_loss: 0.1079 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0983 - val_loss: 0.1073 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0992 - val_loss: 0.1107 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0990 - val_loss: 0.1134 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0983 - val_loss: 0.1130 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0972 - val_loss: 0.1120 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1002 - val_loss: 0.1115 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0993 - val_loss: 0.1113 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1000 - val_loss: 0.1111 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0985 - val_loss: 0.1109 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1002 - val_loss: 0.1108 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0980 - val_loss: 0.1108 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0972 - val_loss: 0.1107 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0986 - val_loss: 0.1106 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0992 - val_loss: 0.1106 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0996 - val_loss: 0.1107 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0970 - val_loss: 0.1107 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0999 - val_loss: 0.1107 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1009 - val_loss: 0.1107 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0996 - val_loss: 0.1107 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0994 - val_loss: 0.1107 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0995 - val_loss: 0.1107 - lr: 1.0104e-07
Epoch 1/100
13/13 [==============================] - 4s 86ms/step - loss: 0.2021 - val_loss: 0.1918 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1696 - val_loss: 0.1717 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1632 - val_loss: 0.1675 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1523 - val_loss: 0.1555 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1428 - val_loss: 0.1424 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1379 - val_loss: 0.1298 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1304 - val_loss: 0.1217 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1228 - val_loss: 0.1112 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1243 - val_loss: 0.1075 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1137 - val_loss: 0.0972 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1106 - val_loss: 0.0902 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1071 - val_loss: 0.0879 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0995 - val_loss: 0.0875 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0961 - val_loss: 0.0840 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0929 - val_loss: 0.0799 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0898 - val_loss: 0.0796 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0874 - val_loss: 0.0760 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0879 - val_loss: 0.0760 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0881 - val_loss: 0.0773 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0864 - val_loss: 0.0788 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0840 - val_loss: 0.0759 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0742 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0825 - val_loss: 0.0740 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0817 - val_loss: 0.0739 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0814 - val_loss: 0.0753 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0737 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0802 - val_loss: 0.0748 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0803 - val_loss: 0.0738 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0813 - val_loss: 0.0733 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0793 - val_loss: 0.0729 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0812 - val_loss: 0.0729 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0815 - val_loss: 0.0728 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0805 - val_loss: 0.0733 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0811 - val_loss: 0.0736 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0818 - val_loss: 0.0737 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0791 - val_loss: 0.0736 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0809 - val_loss: 0.0737 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0796 - val_loss: 0.0738 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0798 - val_loss: 0.0738 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0795 - val_loss: 0.0738 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0802 - val_loss: 0.0739 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0792 - val_loss: 0.0739 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0792 - val_loss: 0.0738 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0806 - val_loss: 0.0738 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0805 - val_loss: 0.0738 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0806 - val_loss: 0.0738 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0797 - val_loss: 0.0738 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0803 - val_loss: 0.0738 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0809 - val_loss: 0.0738 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0800 - val_loss: 0.0738 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0810 - val_loss: 0.0738 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0808 - val_loss: 0.0738 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 4s 72ms/step - loss: 0.2160 - val_loss: 0.1550 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1600 - val_loss: 0.1544 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1525 - val_loss: 0.1403 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1399 - val_loss: 0.1391 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1359 - val_loss: 0.1372 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1265 - val_loss: 0.1377 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1223 - val_loss: 0.1328 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1185 - val_loss: 0.1243 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1131 - val_loss: 0.1262 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1114 - val_loss: 0.1171 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1072 - val_loss: 0.1089 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1026 - val_loss: 0.1021 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0989 - val_loss: 0.0977 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0948 - val_loss: 0.0978 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0938 - val_loss: 0.0963 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0923 - val_loss: 0.0898 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0900 - val_loss: 0.0895 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0895 - val_loss: 0.0855 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0878 - val_loss: 0.0872 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0881 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0848 - val_loss: 0.0786 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0842 - val_loss: 0.0752 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0816 - val_loss: 0.0744 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0824 - val_loss: 0.0740 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0828 - val_loss: 0.0732 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0818 - val_loss: 0.0725 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0811 - val_loss: 0.0719 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0813 - val_loss: 0.0722 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0814 - val_loss: 0.0720 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0801 - val_loss: 0.0719 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0813 - val_loss: 0.0710 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0809 - val_loss: 0.0709 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0817 - val_loss: 0.0711 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0802 - val_loss: 0.0710 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0799 - val_loss: 0.0709 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0809 - val_loss: 0.0707 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0804 - val_loss: 0.0706 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0812 - val_loss: 0.0706 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0798 - val_loss: 0.0707 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0806 - val_loss: 0.0707 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0807 - val_loss: 0.0707 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0794 - val_loss: 0.0707 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0707 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0801 - val_loss: 0.0707 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0799 - val_loss: 0.0707 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0707 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0790 - val_loss: 0.0707 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0809 - val_loss: 0.0707 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0805 - val_loss: 0.0707 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0817 - val_loss: 0.0707 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0798 - val_loss: 0.0707 - lr: 1.3710e-09

Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0803 - val_loss: 0.0707 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.0707 - lr: 5.0435e-10
Epoch 1/100
22/22 [==============================] - 5s 70ms/step - loss: 0.2054 - val_loss: 0.1541 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1627 - val_loss: 0.1469 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1505 - val_loss: 0.1429 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1411 - val_loss: 0.1351 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1340 - val_loss: 0.1327 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1288 - val_loss: 0.1264 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1247 - val_loss: 0.1234 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1198 - val_loss: 0.1219 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1183 - val_loss: 0.1229 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1148 - val_loss: 0.1168 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1084 - val_loss: 0.1125 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 22ms/step - loss: 0.1041 - val_loss: 0.1131 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1033 - val_loss: 0.1122 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1030 - val_loss: 0.1127 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0984 - val_loss: 0.1048 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0929 - val_loss: 0.1050 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0903 - val_loss: 0.1031 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0875 - val_loss: 0.1003 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0855 - val_loss: 0.0995 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0837 - val_loss: 0.0976 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0834 - val_loss: 0.0935 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0804 - val_loss: 0.0890 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0777 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0764 - val_loss: 0.0845 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0747 - val_loss: 0.0832 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0743 - val_loss: 0.0823 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0738 - val_loss: 0.0819 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0736 - val_loss: 0.0814 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0810 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0731 - val_loss: 0.0808 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0735 - val_loss: 0.0806 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0805 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0804 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0804 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0735 - val_loss: 0.0803 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0803 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0725 - val_loss: 0.0802 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0728 - val_loss: 0.0802 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0712 - val_loss: 0.0802 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0733 - val_loss: 0.0802 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0728 - val_loss: 0.0802 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0731 - val_loss: 0.0802 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0740 - val_loss: 0.0802 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0732 - val_loss: 0.0802 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0726 - val_loss: 0.0802 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0729 - val_loss: 0.0802 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.5175e-12

Epoch 69/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0727 - val_loss: 0.0802 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0730 - val_loss: 0.0802 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0734 - val_loss: 0.0802 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0719 - val_loss: 0.0802 - lr: 4.6110e-14
Average Validation Loss: 0.09341935217380523
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 67ms/step - loss: 0.1322 - val_loss: 0.1343 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1142 - val_loss: 0.1300 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1116 - val_loss: 0.1240 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1081 - val_loss: 0.1169 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0909 - val_loss: 0.1269 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0998 - val_loss: 0.1106 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0822 - val_loss: 0.1125 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0852 - val_loss: 0.1062 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0694 - val_loss: 0.1093 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0651 - val_loss: 0.1128 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0707 - val_loss: 0.1072 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0647 - val_loss: 0.1017 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0556 - val_loss: 0.0972 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0523 - val_loss: 0.1004 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0523 - val_loss: 0.0973 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0496 - val_loss: 0.1132 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0524 - val_loss: 0.0945 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0482 - val_loss: 0.1046 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0473 - val_loss: 0.0991 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0477 - val_loss: 0.0988 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0480 - val_loss: 0.0965 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0472 - val_loss: 0.0953 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0479 - val_loss: 0.1003 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0481 - val_loss: 0.0994 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0465 - val_loss: 0.1003 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0462 - val_loss: 0.0995 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0459 - val_loss: 0.0948 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 37ms/step - loss: 0.0455 - val_loss: 0.1005 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0450 - val_loss: 0.0994 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0478 - val_loss: 0.0985 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0444 - val_loss: 0.0982 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0459 - val_loss: 0.0992 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0447 - val_loss: 0.0988 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0466 - val_loss: 0.0986 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0456 - val_loss: 0.0985 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0457 - val_loss: 0.0985 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0454 - val_loss: 0.0986 - lr: 6.0967e-06
Epoch 1/100
34/34 [==============================] - 4s 47ms/step - loss: 0.1335 - val_loss: 0.0687 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1270 - val_loss: 0.0752 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1195 - val_loss: 0.0686 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1197 - val_loss: 0.0687 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1129 - val_loss: 0.0659 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1075 - val_loss: 0.0765 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1067 - val_loss: 0.0671 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1047 - val_loss: 0.0683 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1005 - val_loss: 0.0877 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0979 - val_loss: 0.0631 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0945 - val_loss: 0.0765 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0857 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0854 - val_loss: 0.0726 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0839 - val_loss: 0.0677 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0802 - val_loss: 0.0686 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0748 - val_loss: 0.0645 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0716 - val_loss: 0.0700 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0662 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0656 - val_loss: 0.0602 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0646 - val_loss: 0.0591 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0621 - val_loss: 0.0633 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0620 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0585 - val_loss: 0.0620 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0577 - val_loss: 0.0655 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0570 - val_loss: 0.0638 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0573 - val_loss: 0.0659 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0568 - val_loss: 0.0650 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0524 - val_loss: 0.0671 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0539 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0552 - val_loss: 0.0662 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0534 - val_loss: 0.0658 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0542 - val_loss: 0.0673 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0550 - val_loss: 0.0665 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0533 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0557 - val_loss: 0.0669 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0543 - val_loss: 0.0667 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0530 - val_loss: 0.0669 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0542 - val_loss: 0.0670 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0531 - val_loss: 0.0668 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0536 - val_loss: 0.0667 - lr: 2.4788e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.1326 - val_loss: 0.1147 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1133 - val_loss: 0.1058 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1091 - val_loss: 0.0994 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1034 - val_loss: 0.0949 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0989 - val_loss: 0.0900 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0951 - val_loss: 0.0912 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0982 - val_loss: 0.0890 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0894 - val_loss: 0.0859 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0864 - val_loss: 0.0769 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0886 - val_loss: 0.0796 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0782 - val_loss: 0.0748 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0733 - val_loss: 0.0731 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0715 - val_loss: 0.0694 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0673 - val_loss: 0.0671 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0661 - val_loss: 0.0653 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0631 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0614 - val_loss: 0.0622 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0624 - val_loss: 0.0629 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0612 - val_loss: 0.0614 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0621 - val_loss: 0.0613 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0587 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0627 - val_loss: 0.0550 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0605 - val_loss: 0.0544 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0540 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0539 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0552 - val_loss: 0.0539 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0569 - val_loss: 0.0552 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0543 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0548 - val_loss: 0.0548 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0542 - val_loss: 0.0543 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0528 - val_loss: 0.0540 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0524 - val_loss: 0.0540 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0531 - val_loss: 0.0542 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0525 - val_loss: 0.0541 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0534 - val_loss: 0.0544 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0521 - val_loss: 0.0544 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0524 - val_loss: 0.0544 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0544 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0532 - val_loss: 0.0543 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0536 - val_loss: 0.0543 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0528 - val_loss: 0.0543 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0533 - val_loss: 0.0543 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0523 - val_loss: 0.0543 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0521 - val_loss: 0.0543 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0543 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 5s 28ms/step - loss: 0.1303 - val_loss: 0.1195 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 16ms/step - loss: 0.1156 - val_loss: 0.1156 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1083 - val_loss: 0.1033 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1030 - val_loss: 0.0989 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0959 - val_loss: 0.0923 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0902 - val_loss: 0.0989 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0888 - val_loss: 0.0881 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0816 - val_loss: 0.0918 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0772 - val_loss: 0.0899 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0753 - val_loss: 0.0959 - lr: 0.0010
Epoch 11/100

68/68 [==============================] - 1s 18ms/step - loss: 0.0734 - val_loss: 0.0889 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0704 - val_loss: 0.0772 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0660 - val_loss: 0.0778 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0645 - val_loss: 0.0759 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0638 - val_loss: 0.0722 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0617 - val_loss: 0.0734 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0728 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0744 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0587 - val_loss: 0.0739 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0577 - val_loss: 0.0721 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0723 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0721 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0566 - val_loss: 0.0741 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0568 - val_loss: 0.0692 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0653 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0552 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0550 - val_loss: 0.0612 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0537 - val_loss: 0.0594 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0534 - val_loss: 0.0578 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0567 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0524 - val_loss: 0.0561 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0559 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0525 - val_loss: 0.0555 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0554 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0551 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0550 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0549 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0518 - val_loss: 0.0548 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0548 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0513 - val_loss: 0.0548 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0548 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0508 - val_loss: 0.0548 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0523 - val_loss: 0.0548 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0519 - val_loss: 0.0548 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0511 - val_loss: 0.0548 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0548 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0517 - val_loss: 0.0548 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0548 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0548 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0548 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0499 - val_loss: 0.0548 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0510 - val_loss: 0.0548 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0515 - val_loss: 0.0548 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0509 - val_loss: 0.0548 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0516 - val_loss: 0.0548 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0507 - val_loss: 0.0548 - lr: 1.3924e-15
Epoch 1/100
85/85 [==============================] - 7s 32ms/step - loss: 0.1237 - val_loss: 0.1066 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1053 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1033 - val_loss: 0.1028 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0945 - val_loss: 0.1013 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0931 - val_loss: 0.0996 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0888 - val_loss: 0.0984 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0882 - val_loss: 0.0967 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0861 - val_loss: 0.0955 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0831 - val_loss: 0.0943 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0815 - val_loss: 0.0929 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0746 - val_loss: 0.0902 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0756 - val_loss: 0.0881 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0676 - val_loss: 0.0880 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0699 - val_loss: 0.0864 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0641 - val_loss: 0.0855 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0654 - val_loss: 0.0848 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0615 - val_loss: 0.0842 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0606 - val_loss: 0.0824 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0817 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0578 - val_loss: 0.0809 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0790 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0546 - val_loss: 0.0782 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0529 - val_loss: 0.0777 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0512 - val_loss: 0.0776 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0770 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0502 - val_loss: 0.0762 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0759 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0758 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0486 - val_loss: 0.0755 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0746 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0493 - val_loss: 0.0743 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0490 - val_loss: 0.0738 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0734 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0732 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0476 - val_loss: 0.0729 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0727 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0726 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0481 - val_loss: 0.0726 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0467 - val_loss: 0.0725 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0465 - val_loss: 0.0725 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0725 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0485 - val_loss: 0.0725 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0474 - val_loss: 0.0725 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0464 - val_loss: 0.0725 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0484 - val_loss: 0.0725 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0725 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0464 - val_loss: 0.0725 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0477 - val_loss: 0.0725 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0471 - val_loss: 0.0725 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0473 - val_loss: 0.0725 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0470 - val_loss: 0.0725 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0477 - val_loss: 0.0725 - lr: 7.5826e-13

Epoch 71/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0476 - val_loss: 0.0725 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0725 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0472 - val_loss: 0.0725 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0480 - val_loss: 0.0725 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0475 - val_loss: 0.0725 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0478 - val_loss: 0.0725 - lr: 2.8039e-15
Average Validation Loss: 0.06693153455853462
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 125ms/step - loss: 0.1562 - val_loss: 0.1349 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1128 - val_loss: 0.1438 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1181 - val_loss: 0.1331 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1068 - val_loss: 0.1192 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0993 - val_loss: 0.1098 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0938 - val_loss: 0.1065 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0891 - val_loss: 0.1065 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0850 - val_loss: 0.1013 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0805 - val_loss: 0.0967 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0733 - val_loss: 0.0942 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0691 - val_loss: 0.0891 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0645 - val_loss: 0.0896 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0600 - val_loss: 0.0919 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0609 - val_loss: 0.0892 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0548 - val_loss: 0.0933 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0564 - val_loss: 0.0939 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0543 - val_loss: 0.0939 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0538 - val_loss: 0.0916 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0512 - val_loss: 0.0929 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0526 - val_loss: 0.0931 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0526 - val_loss: 0.0890 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0518 - val_loss: 0.0903 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0521 - val_loss: 0.0880 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0504 - val_loss: 0.0932 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0524 - val_loss: 0.0921 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0499 - val_loss: 0.0901 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0495 - val_loss: 0.0913 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0912 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0508 - val_loss: 0.0905 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0530 - val_loss: 0.0908 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0513 - val_loss: 0.0906 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0504 - val_loss: 0.0903 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0490 - val_loss: 0.0904 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0511 - val_loss: 0.0903 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0493 - val_loss: 0.0900 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0485 - val_loss: 0.0901 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0495 - val_loss: 0.0902 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0526 - val_loss: 0.0903 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0532 - val_loss: 0.0903 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0502 - val_loss: 0.0903 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0488 - val_loss: 0.0903 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0492 - val_loss: 0.0904 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0512 - val_loss: 0.0904 - lr: 7.4659e-07
Epoch 1/100
17/17 [==============================] - 4s 66ms/step - loss: 0.1380 - val_loss: 0.0905 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1272 - val_loss: 0.0869 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1218 - val_loss: 0.0811 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1175 - val_loss: 0.0732 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1176 - val_loss: 0.0750 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1109 - val_loss: 0.0829 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1075 - val_loss: 0.0653 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1010 - val_loss: 0.0881 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1005 - val_loss: 0.0730 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0983 - val_loss: 0.0734 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0875 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0808 - val_loss: 0.0936 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0822 - val_loss: 0.0765 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0799 - val_loss: 0.0713 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0759 - val_loss: 0.0774 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0703 - val_loss: 0.0889 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0697 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0691 - val_loss: 0.0851 - lr: 4.4933e-04

Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0671 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0680 - val_loss: 0.0755 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0666 - val_loss: 0.0796 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0656 - val_loss: 0.0785 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0645 - val_loss: 0.0822 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0641 - val_loss: 0.0782 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0640 - val_loss: 0.0847 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0641 - val_loss: 0.0799 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0648 - val_loss: 0.0761 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 5s 50ms/step - loss: 0.1391 - val_loss: 0.1229 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1107 - val_loss: 0.1118 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 20ms/step - loss: 0.1048 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0990 - val_loss: 0.0928 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0959 - val_loss: 0.0868 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0865 - val_loss: 0.0756 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0838 - val_loss: 0.0694 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0798 - val_loss: 0.0668 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0777 - val_loss: 0.0650 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0756 - val_loss: 0.0719 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0788 - val_loss: 0.0720 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0791 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0638 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0677 - val_loss: 0.0616 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0689 - val_loss: 0.0620 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0690 - val_loss: 0.0589 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0645 - val_loss: 0.0584 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0637 - val_loss: 0.0561 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0545 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0545 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0628 - val_loss: 0.0517 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0515 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0574 - val_loss: 0.0506 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0561 - val_loss: 0.0501 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0572 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0561 - val_loss: 0.0497 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 19ms/step - loss: 0.0548 - val_loss: 0.0500 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0555 - val_loss: 0.0496 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0557 - val_loss: 0.0496 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0546 - val_loss: 0.0493 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0543 - val_loss: 0.0490 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0543 - val_loss: 0.0491 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0540 - val_loss: 0.0491 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0551 - val_loss: 0.0491 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0549 - val_loss: 0.0491 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0544 - val_loss: 0.0490 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0542 - val_loss: 0.0491 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0549 - val_loss: 0.0490 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0545 - val_loss: 0.0490 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0536 - val_loss: 0.0490 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0535 - val_loss: 0.0490 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0549 - val_loss: 0.0490 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0534 - val_loss: 0.0490 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0545 - val_loss: 0.0490 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0538 - val_loss: 0.0490 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0544 - val_loss: 0.0490 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0526 - val_loss: 0.0490 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0530 - val_loss: 0.0490 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0552 - val_loss: 0.0490 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0541 - val_loss: 0.0490 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 5s 44ms/step - loss: 0.1246 - val_loss: 0.1100 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1070 - val_loss: 0.1148 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1011 - val_loss: 0.1042 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0963 - val_loss: 0.1034 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.0994 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0850 - val_loss: 0.0816 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0776 - val_loss: 0.0723 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0759 - val_loss: 0.0732 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0725 - val_loss: 0.0740 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0691 - val_loss: 0.0612 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0666 - val_loss: 0.0630 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0652 - val_loss: 0.0633 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0609 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0625 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0599 - val_loss: 0.0604 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0582 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0566 - val_loss: 0.0607 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0579 - val_loss: 0.0699 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0581 - val_loss: 0.0613 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0734 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0780 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0663 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0622 - val_loss: 0.0520 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0585 - val_loss: 0.0493 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0570 - val_loss: 0.0486 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0553 - val_loss: 0.0479 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0543 - val_loss: 0.0474 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0539 - val_loss: 0.0471 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0468 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0532 - val_loss: 0.0465 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0464 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0530 - val_loss: 0.0463 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0462 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0530 - val_loss: 0.0462 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0532 - val_loss: 0.0461 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0522 - val_loss: 0.0461 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0526 - val_loss: 0.0461 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0461 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0461 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0461 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0515 - val_loss: 0.0461 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0520 - val_loss: 0.0461 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0522 - val_loss: 0.0461 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0532 - val_loss: 0.0461 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0519 - val_loss: 0.0461 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0520 - val_loss: 0.0461 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0514 - val_loss: 0.0461 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0516 - val_loss: 0.0461 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0510 - val_loss: 0.0461 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0527 - val_loss: 0.0461 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0513 - val_loss: 0.0461 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0525 - val_loss: 0.0461 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0517 - val_loss: 0.0461 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0461 - lr: 4.6110e-14
Epoch 1/100
43/43 [==============================] - 5s 43ms/step - loss: 0.1218 - val_loss: 0.1080 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 22ms/step - loss: 0.1124 - val_loss: 0.1059 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1037 - val_loss: 0.1045 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0965 - val_loss: 0.1035 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0931 - val_loss: 0.1027 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0877 - val_loss: 0.1020 - lr: 0.0010

Epoch 7/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0840 - val_loss: 0.1003 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0802 - val_loss: 0.0985 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0770 - val_loss: 0.0971 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0772 - val_loss: 0.0944 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0748 - val_loss: 0.0924 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0702 - val_loss: 0.0900 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0674 - val_loss: 0.0891 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0646 - val_loss: 0.0873 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0613 - val_loss: 0.0864 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0608 - val_loss: 0.0851 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0602 - val_loss: 0.0829 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0584 - val_loss: 0.0821 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0569 - val_loss: 0.0822 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0573 - val_loss: 0.0806 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0553 - val_loss: 0.0791 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0550 - val_loss: 0.0790 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0784 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0539 - val_loss: 0.0781 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0545 - val_loss: 0.0780 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0537 - val_loss: 0.0773 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0559 - val_loss: 0.0772 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0552 - val_loss: 0.0765 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0538 - val_loss: 0.0755 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0535 - val_loss: 0.0749 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0523 - val_loss: 0.0745 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0525 - val_loss: 0.0743 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0516 - val_loss: 0.0741 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0739 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0507 - val_loss: 0.0738 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0514 - val_loss: 0.0738 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0737 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0517 - val_loss: 0.0737 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0737 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0514 - val_loss: 0.0737 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0737 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0520 - val_loss: 0.0736 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0515 - val_loss: 0.0736 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0521 - val_loss: 0.0736 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0510 - val_loss: 0.0736 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0515 - val_loss: 0.0736 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0521 - val_loss: 0.0736 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0520 - val_loss: 0.0736 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0508 - val_loss: 0.0736 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0516 - val_loss: 0.0736 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0513 - val_loss: 0.0736 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0514 - val_loss: 0.0736 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0509 - val_loss: 0.0736 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0512 - val_loss: 0.0736 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0736 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0511 - val_loss: 0.0736 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0513 - val_loss: 0.0736 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0518 - val_loss: 0.0736 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0517 - val_loss: 0.0736 - lr: 1.1370e-14
Average Validation Loss: 0.06438567265868186
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 213ms/step - loss: 0.1980 - val_loss: 0.1647 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1341 - val_loss: 0.1374 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1199 - val_loss: 0.1381 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1189 - val_loss: 0.1414 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1175 - val_loss: 0.1439 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1178 - val_loss: 0.1433 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1142 - val_loss: 0.1399 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1101 - val_loss: 0.1346 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1074 - val_loss: 0.1285 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1022 - val_loss: 0.1232 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0977 - val_loss: 0.1205 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0952 - val_loss: 0.1192 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0938 - val_loss: 0.1177 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0930 - val_loss: 0.1166 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0868 - val_loss: 0.1157 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0879 - val_loss: 0.1135 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0822 - val_loss: 0.1116 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0804 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0749 - val_loss: 0.1101 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0708 - val_loss: 0.1082 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0731 - val_loss: 0.1055 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0684 - val_loss: 0.1045 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0677 - val_loss: 0.1039 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0660 - val_loss: 0.1037 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0625 - val_loss: 0.1036 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0643 - val_loss: 0.1032 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0643 - val_loss: 0.1032 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0644 - val_loss: 0.1033 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0614 - val_loss: 0.1033 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0612 - val_loss: 0.1030 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0625 - val_loss: 0.1028 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0618 - val_loss: 0.1028 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0592 - val_loss: 0.1028 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0617 - val_loss: 0.1029 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0609 - val_loss: 0.1029 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0609 - val_loss: 0.1029 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0620 - val_loss: 0.1030 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0641 - val_loss: 0.1030 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0634 - val_loss: 0.1030 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0601 - val_loss: 0.1030 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0609 - val_loss: 0.1030 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0596 - val_loss: 0.1030 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0604 - val_loss: 0.1030 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0659 - val_loss: 0.1030 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0652 - val_loss: 0.1030 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0635 - val_loss: 0.1030 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0615 - val_loss: 0.1030 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0635 - val_loss: 0.1030 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0604 - val_loss: 0.1030 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0602 - val_loss: 0.1030 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0606 - val_loss: 0.1030 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0616 - val_loss: 0.1030 - lr: 1.6702e-08
Epoch 1/100
9/9 [==============================] - 5s 255ms/step - loss: 0.1377 - val_loss: 0.0905 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1309 - val_loss: 0.0869 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1203 - val_loss: 0.0891 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1174 - val_loss: 0.0824 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1154 - val_loss: 0.0744 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1102 - val_loss: 0.0769 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1054 - val_loss: 0.0820 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1026 - val_loss: 0.0791 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0967 - val_loss: 0.0828 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.0885 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0892 - val_loss: 0.0933 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0856 - val_loss: 0.0956 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0830 - val_loss: 0.0949 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0814 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0776 - val_loss: 0.1021 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0767 - val_loss: 0.0938 - lr: 5.4881e-04
Epoch 17/100

9/9 [==============================] - 0s 27ms/step - loss: 0.0769 - val_loss: 0.1054 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0763 - val_loss: 0.1027 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0754 - val_loss: 0.1043 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0742 - val_loss: 0.0983 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0747 - val_loss: 0.1107 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0719 - val_loss: 0.0977 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0719 - val_loss: 0.1028 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0714 - val_loss: 0.1032 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0730 - val_loss: 0.1057 - lr: 1.3534e-04
Epoch 1/100
13/13 [==============================] - 4s 92ms/step - loss: 0.1317 - val_loss: 0.1255 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1145 - val_loss: 0.1156 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1042 - val_loss: 0.1096 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0960 - val_loss: 0.0998 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0937 - val_loss: 0.0950 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0899 - val_loss: 0.0915 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0870 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0856 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0832 - val_loss: 0.0809 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0812 - val_loss: 0.0787 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0803 - val_loss: 0.0760 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0771 - val_loss: 0.0721 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0749 - val_loss: 0.0729 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0723 - val_loss: 0.0692 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0695 - val_loss: 0.0671 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0708 - val_loss: 0.0653 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0702 - val_loss: 0.0650 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0670 - val_loss: 0.0636 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0670 - val_loss: 0.0624 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0674 - val_loss: 0.0621 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0654 - val_loss: 0.0611 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0646 - val_loss: 0.0613 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0650 - val_loss: 0.0615 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0638 - val_loss: 0.0603 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0642 - val_loss: 0.0610 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0629 - val_loss: 0.0603 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0635 - val_loss: 0.0595 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0628 - val_loss: 0.0605 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0625 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0623 - val_loss: 0.0598 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0615 - val_loss: 0.0595 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0611 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0625 - val_loss: 0.0594 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0621 - val_loss: 0.0595 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0621 - val_loss: 0.0595 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0620 - val_loss: 0.0595 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0627 - val_loss: 0.0595 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0631 - val_loss: 0.0596 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0616 - val_loss: 0.0596 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0627 - val_loss: 0.0596 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0634 - val_loss: 0.0596 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0630 - val_loss: 0.0596 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0610 - val_loss: 0.0596 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0613 - val_loss: 0.0596 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0626 - val_loss: 0.0596 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0617 - val_loss: 0.0596 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0627 - val_loss: 0.0596 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0603 - val_loss: 0.0596 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0618 - val_loss: 0.0596 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0620 - val_loss: 0.0596 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0622 - val_loss: 0.0596 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0644 - val_loss: 0.0596 - lr: 1.6702e-08
Epoch 1/100
17/17 [==============================] - 5s 74ms/step - loss: 0.1235 - val_loss: 0.1201 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1142 - val_loss: 0.1017 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1058 - val_loss: 0.0995 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0997 - val_loss: 0.1022 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0966 - val_loss: 0.0981 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0926 - val_loss: 0.0983 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0901 - val_loss: 0.0955 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0890 - val_loss: 0.0929 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0843 - val_loss: 0.0868 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0806 - val_loss: 0.0826 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0765 - val_loss: 0.0882 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0777 - val_loss: 0.0853 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0771 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0780 - val_loss: 0.0700 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0716 - val_loss: 0.0678 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0699 - val_loss: 0.0651 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0682 - val_loss: 0.0634 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0677 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0668 - val_loss: 0.0600 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0650 - val_loss: 0.0610 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0655 - val_loss: 0.0570 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0623 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0624 - val_loss: 0.0556 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0623 - val_loss: 0.0552 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0608 - val_loss: 0.0546 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0608 - val_loss: 0.0543 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0610 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0605 - val_loss: 0.0539 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0616 - val_loss: 0.0534 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0586 - val_loss: 0.0532 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0593 - val_loss: 0.0532 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0587 - val_loss: 0.0531 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0601 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0592 - val_loss: 0.0530 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0598 - val_loss: 0.0529 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0618 - val_loss: 0.0529 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0607 - val_loss: 0.0529 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0603 - val_loss: 0.0529 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0593 - val_loss: 0.0529 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0601 - val_loss: 0.0528 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0607 - val_loss: 0.0528 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0591 - val_loss: 0.0528 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0603 - val_loss: 0.0528 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0585 - val_loss: 0.0528 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0601 - val_loss: 0.0528 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0600 - val_loss: 0.0528 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0609 - val_loss: 0.0528 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0588 - val_loss: 0.0528 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0610 - val_loss: 0.0528 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0587 - val_loss: 0.0528 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0597 - val_loss: 0.0528 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 49ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 44ms/step - loss: 0.0594 - val_loss: 0.0528 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0604 - val_loss: 0.0528 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0587 - val_loss: 0.0528 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0606 - val_loss: 0.0528 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0609 - val_loss: 0.0528 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0605 - val_loss: 0.0528 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0590 - val_loss: 0.0528 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0599 - val_loss: 0.0528 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0596 - val_loss: 0.0528 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 44ms/step - loss: 0.0595 - val_loss: 0.0528 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0602 - val_loss: 0.0528 - lr: 4.6110e-14
Epoch 1/100
22/22 [==============================] - 6s 96ms/step - loss: 0.1183 - val_loss: 0.1068 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1082 - val_loss: 0.1049 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1039 - val_loss: 0.1015 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0956 - val_loss: 0.0967 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0924 - val_loss: 0.0937 - lr: 0.0010

Epoch 6/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0930 - val_loss: 0.0955 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0895 - val_loss: 0.0918 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0882 - val_loss: 0.0896 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0850 - val_loss: 0.0899 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0815 - val_loss: 0.0863 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0796 - val_loss: 0.0858 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0771 - val_loss: 0.0848 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0760 - val_loss: 0.0829 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0735 - val_loss: 0.0800 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0689 - val_loss: 0.0767 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0670 - val_loss: 0.0719 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0650 - val_loss: 0.0704 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0642 - val_loss: 0.0670 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0609 - val_loss: 0.0652 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0597 - val_loss: 0.0623 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0579 - val_loss: 0.0580 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0571 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0558 - val_loss: 0.0541 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0548 - val_loss: 0.0531 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0547 - val_loss: 0.0525 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0543 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0542 - val_loss: 0.0514 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0533 - val_loss: 0.0512 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0511 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0537 - val_loss: 0.0506 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0528 - val_loss: 0.0504 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0537 - val_loss: 0.0504 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0545 - val_loss: 0.0504 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0531 - val_loss: 0.0504 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0529 - val_loss: 0.0503 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0530 - val_loss: 0.0501 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0539 - val_loss: 0.0502 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0534 - val_loss: 0.0502 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0532 - val_loss: 0.0502 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0531 - val_loss: 0.0502 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0528 - val_loss: 0.0502 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0542 - val_loss: 0.0502 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0526 - val_loss: 0.0502 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0532 - val_loss: 0.0502 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0530 - val_loss: 0.0502 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0540 - val_loss: 0.0502 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0537 - val_loss: 0.0502 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0529 - val_loss: 0.0502 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0525 - val_loss: 0.0502 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0535 - val_loss: 0.0502 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0534 - val_loss: 0.0502 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0530 - val_loss: 0.0502 - lr: 2.2603e-09
Average Validation Loss: 0.06788384094834328
Current Best Configuration: {'neurons': 16, 'dropout': 0.2, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 77ms/step - loss: 0.1111 - val_loss: 0.1285 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1086 - val_loss: 0.1231 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1094 - val_loss: 0.1130 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 24ms/step - loss: 0.1079 - val_loss: 0.1099 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0945 - val_loss: 0.1113 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0932 - val_loss: 0.1072 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0907 - val_loss: 0.1038 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0861 - val_loss: 0.1038 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0817 - val_loss: 0.0963 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0702 - val_loss: 0.0938 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0602 - val_loss: 0.1062 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0671 - val_loss: 0.0905 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0529 - val_loss: 0.0979 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0537 - val_loss: 0.0869 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0551 - val_loss: 0.0956 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0502 - val_loss: 0.0827 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0898 - lr: 4.9659e-04

Epoch 18/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0492 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0455 - val_loss: 0.0809 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0438 - val_loss: 0.0966 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0477 - val_loss: 0.0787 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0441 - val_loss: 0.0954 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0476 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0418 - val_loss: 0.0895 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0444 - val_loss: 0.0806 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0445 - val_loss: 0.0852 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0423 - val_loss: 0.0869 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0428 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0408 - val_loss: 0.0841 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0446 - val_loss: 0.0847 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0422 - val_loss: 0.0838 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0417 - val_loss: 0.0847 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0429 - val_loss: 0.0850 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0415 - val_loss: 0.0842 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0428 - val_loss: 0.0839 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0421 - val_loss: 0.0840 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0422 - val_loss: 0.0838 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0413 - val_loss: 0.0837 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 1s 80ms/step - loss: 0.0411 - val_loss: 0.0838 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 4s 227ms/step - loss: 0.0418 - val_loss: 0.0839 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 3s 151ms/step - loss: 0.0421 - val_loss: 0.0840 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 8s 77ms/step - loss: 0.1495 - val_loss: 0.0798 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1306 - val_loss: 0.0794 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1145 - val_loss: 0.0747 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1161 - val_loss: 0.0621 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1137 - val_loss: 0.0729 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1073 - val_loss: 0.0581 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1035 - val_loss: 0.0675 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1008 - val_loss: 0.0616 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1000 - val_loss: 0.0623 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0967 - val_loss: 0.0611 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0899 - val_loss: 0.0763 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0687 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0858 - val_loss: 0.0670 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0820 - val_loss: 0.0681 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0760 - val_loss: 0.0694 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0717 - val_loss: 0.0712 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0696 - val_loss: 0.0651 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0671 - val_loss: 0.0677 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0635 - val_loss: 0.0605 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0611 - val_loss: 0.0581 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0593 - val_loss: 0.0555 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0581 - val_loss: 0.0539 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0557 - val_loss: 0.0569 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0544 - val_loss: 0.0581 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0594 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0515 - val_loss: 0.0607 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0508 - val_loss: 0.0586 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0618 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0612 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0492 - val_loss: 0.0597 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0592 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0507 - val_loss: 0.0595 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0495 - val_loss: 0.0612 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0508 - val_loss: 0.0613 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0608 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0509 - val_loss: 0.0608 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0505 - val_loss: 0.0609 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0496 - val_loss: 0.0610 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0494 - val_loss: 0.0609 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0496 - val_loss: 0.0609 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0506 - val_loss: 0.0609 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 6s 45ms/step - loss: 0.1112 - val_loss: 0.1042 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1013 - val_loss: 0.0958 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0971 - val_loss: 0.0884 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0933 - val_loss: 0.0833 - lr: 0.0010

Epoch 5/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0924 - val_loss: 0.0839 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0857 - val_loss: 0.0790 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0839 - val_loss: 0.0767 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0808 - val_loss: 0.0750 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0737 - val_loss: 0.0628 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0737 - val_loss: 0.0810 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0727 - val_loss: 0.0610 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0687 - val_loss: 0.0728 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0636 - val_loss: 0.0524 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0588 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0496 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0531 - val_loss: 0.0553 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0522 - val_loss: 0.0466 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0503 - val_loss: 0.0513 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0509 - val_loss: 0.0479 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0481 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0462 - val_loss: 0.0463 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0462 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0459 - val_loss: 0.0449 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0480 - val_loss: 0.0446 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0480 - val_loss: 0.0442 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0482 - val_loss: 0.0449 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0477 - val_loss: 0.0468 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0476 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0478 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0478 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0456 - val_loss: 0.0478 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0444 - val_loss: 0.0478 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0444 - val_loss: 0.0478 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0441 - val_loss: 0.0479 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0479 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0442 - val_loss: 0.0479 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0440 - val_loss: 0.0479 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0478 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0448 - val_loss: 0.0478 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0436 - val_loss: 0.0478 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0448 - val_loss: 0.0478 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0436 - val_loss: 0.0478 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 6s 24ms/step - loss: 0.1160 - val_loss: 0.1038 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 15ms/step - loss: 0.1007 - val_loss: 0.0868 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0962 - val_loss: 0.0917 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0891 - val_loss: 0.0850 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0856 - val_loss: 0.0823 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0820 - val_loss: 0.0828 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0789 - val_loss: 0.0782 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0762 - val_loss: 0.0767 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0727 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0685 - val_loss: 0.0718 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0659 - val_loss: 0.0706 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0636 - val_loss: 0.0685 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0632 - val_loss: 0.0681 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0608 - val_loss: 0.0658 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0591 - val_loss: 0.0677 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0571 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0554 - val_loss: 0.0655 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0547 - val_loss: 0.0646 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0531 - val_loss: 0.0636 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0529 - val_loss: 0.0656 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0517 - val_loss: 0.0652 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0508 - val_loss: 0.0662 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0510 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0508 - val_loss: 0.0629 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0513 - val_loss: 0.0606 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0568 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0498 - val_loss: 0.0551 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0508 - val_loss: 0.0535 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0485 - val_loss: 0.0530 - lr: 6.0810e-05
Epoch 30/100

68/68 [==============================] - 1s 14ms/step - loss: 0.0491 - val_loss: 0.0526 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0474 - val_loss: 0.0517 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0479 - val_loss: 0.0514 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0480 - val_loss: 0.0513 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0468 - val_loss: 0.0511 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0475 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0476 - val_loss: 0.0509 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0509 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0509 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0466 - val_loss: 0.0509 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0508 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0464 - val_loss: 0.0508 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0473 - val_loss: 0.0508 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0470 - val_loss: 0.0508 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0468 - val_loss: 0.0508 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0464 - val_loss: 0.0508 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0469 - val_loss: 0.0508 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0468 - val_loss: 0.0508 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0462 - val_loss: 0.0508 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0467 - val_loss: 0.0508 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0466 - val_loss: 0.0508 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0474 - val_loss: 0.0508 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0465 - val_loss: 0.0508 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0460 - val_loss: 0.0508 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0471 - val_loss: 0.0508 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0475 - val_loss: 0.0508 - lr: 2.8039e-15
Epoch 1/100
85/85 [==============================] - 5s 27ms/step - loss: 0.1178 - val_loss: 0.0955 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1039 - val_loss: 0.0903 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0988 - val_loss: 0.0869 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0942 - val_loss: 0.0863 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0890 - val_loss: 0.0859 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0856 - val_loss: 0.0839 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0842 - val_loss: 0.0826 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0820 - val_loss: 0.0814 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0721 - val_loss: 0.0773 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0701 - val_loss: 0.0756 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0638 - val_loss: 0.0713 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0607 - val_loss: 0.0660 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0582 - val_loss: 0.0634 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0628 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0608 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0543 - val_loss: 0.0610 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0534 - val_loss: 0.0588 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0519 - val_loss: 0.0585 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0501 - val_loss: 0.0592 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0505 - val_loss: 0.0583 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0494 - val_loss: 0.0567 - lr: 3.0119e-04

Epoch 22/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0468 - val_loss: 0.0564 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0457 - val_loss: 0.0551 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0449 - val_loss: 0.0540 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0532 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0439 - val_loss: 0.0529 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0431 - val_loss: 0.0531 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0424 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0425 - val_loss: 0.0521 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0425 - val_loss: 0.0522 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0423 - val_loss: 0.0521 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0428 - val_loss: 0.0518 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0417 - val_loss: 0.0517 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0421 - val_loss: 0.0518 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0517 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0424 - val_loss: 0.0516 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0433 - val_loss: 0.0516 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0415 - val_loss: 0.0516 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0516 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0425 - val_loss: 0.0516 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0419 - val_loss: 0.0516 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0431 - val_loss: 0.0516 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0412 - val_loss: 0.0516 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0416 - val_loss: 0.0516 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0413 - val_loss: 0.0516 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0409 - val_loss: 0.0516 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0415 - val_loss: 0.0516 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0421 - val_loss: 0.0516 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0420 - val_loss: 0.0516 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0409 - val_loss: 0.0516 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0418 - val_loss: 0.0516 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0423 - val_loss: 0.0516 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0417 - val_loss: 0.0516 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0412 - val_loss: 0.0516 - lr: 5.0565e-11
Average Validation Loss: 0.055843637138605115
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 132ms/step - loss: 0.1164 - val_loss: 0.1282 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1030 - val_loss: 0.1290 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 20ms/step - loss: 0.1008 - val_loss: 0.1270 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 21ms/step - loss: 0.1001 - val_loss: 0.1212 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0930 - val_loss: 0.1181 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0858 - val_loss: 0.1159 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0794 - val_loss: 0.1114 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0684 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0661 - val_loss: 0.1054 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0565 - val_loss: 0.1125 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0550 - val_loss: 0.1012 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0504 - val_loss: 0.1093 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0525 - val_loss: 0.1025 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0470 - val_loss: 0.1078 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0474 - val_loss: 0.1014 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0453 - val_loss: 0.1042 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0475 - val_loss: 0.0992 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0456 - val_loss: 0.1016 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0463 - val_loss: 0.0965 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0445 - val_loss: 0.1056 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0470 - val_loss: 0.0948 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0446 - val_loss: 0.0992 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0446 - val_loss: 0.1002 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0456 - val_loss: 0.0974 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0974 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0970 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0427 - val_loss: 0.0978 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0443 - val_loss: 0.0987 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0441 - val_loss: 0.0983 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0430 - val_loss: 0.0973 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0437 - val_loss: 0.0964 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0418 - val_loss: 0.0958 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0428 - val_loss: 0.0958 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0419 - val_loss: 0.0957 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0440 - val_loss: 0.0958 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0430 - val_loss: 0.0959 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0452 - val_loss: 0.0960 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0445 - val_loss: 0.0961 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0415 - val_loss: 0.0960 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 21ms/step - loss: 0.0429 - val_loss: 0.0960 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 20ms/step - loss: 0.0449 - val_loss: 0.0960 - lr: 1.6616e-06
Epoch 1/100
17/17 [==============================] - 4s 56ms/step - loss: 0.1437 - val_loss: 0.0807 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 13ms/step - loss: 0.1216 - val_loss: 0.0797 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 14ms/step - loss: 0.1161 - val_loss: 0.0755 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1118 - val_loss: 0.0684 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1087 - val_loss: 0.0661 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1028 - val_loss: 0.0638 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1008 - val_loss: 0.0604 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0944 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0879 - val_loss: 0.0748 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0889 - val_loss: 0.0628 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0843 - val_loss: 0.0712 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0729 - val_loss: 0.0777 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0691 - val_loss: 0.0726 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0686 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0658 - val_loss: 0.0801 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0650 - val_loss: 0.0739 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0626 - val_loss: 0.0715 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 14ms/step - loss: 0.0636 - val_loss: 0.0751 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0599 - val_loss: 0.0745 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0609 - val_loss: 0.0762 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0592 - val_loss: 0.0716 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0613 - val_loss: 0.0747 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0578 - val_loss: 0.0732 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0581 - val_loss: 0.0759 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0591 - val_loss: 0.0747 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0567 - val_loss: 0.0758 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0591 - val_loss: 0.0730 - lr: 9.0718e-05
Epoch 1/100
26/26 [==============================] - 4s 45ms/step - loss: 0.1129 - val_loss: 0.1128 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 15ms/step - loss: 0.1008 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 15ms/step - loss: 0.0960 - val_loss: 0.0948 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0915 - val_loss: 0.0890 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0870 - val_loss: 0.0837 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0868 - val_loss: 0.0768 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0822 - val_loss: 0.0730 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0792 - val_loss: 0.0697 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0784 - val_loss: 0.0648 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0733 - val_loss: 0.0635 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0687 - val_loss: 0.0603 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0654 - val_loss: 0.0611 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0644 - val_loss: 0.0586 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0637 - val_loss: 0.0574 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0648 - val_loss: 0.0579 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0626 - val_loss: 0.0574 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0619 - val_loss: 0.0587 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0596 - val_loss: 0.0584 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0567 - val_loss: 0.0587 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0550 - val_loss: 0.0567 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0559 - val_loss: 0.0557 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0545 - val_loss: 0.0554 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0530 - val_loss: 0.0559 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0537 - val_loss: 0.0552 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0527 - val_loss: 0.0544 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0524 - val_loss: 0.0538 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0518 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0514 - val_loss: 0.0537 - lr: 7.4274e-05
Epoch 29/100

26/26 [==============================] - 0s 17ms/step - loss: 0.0519 - val_loss: 0.0540 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0539 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0522 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0535 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0518 - val_loss: 0.0536 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0516 - val_loss: 0.0535 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0522 - val_loss: 0.0535 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0522 - val_loss: 0.0534 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0517 - val_loss: 0.0533 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0516 - val_loss: 0.0533 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0514 - val_loss: 0.0533 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0529 - val_loss: 0.0533 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0526 - val_loss: 0.0533 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0510 - val_loss: 0.0533 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 0s 15ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0527 - val_loss: 0.0533 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0505 - val_loss: 0.0533 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0515 - val_loss: 0.0533 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0512 - val_loss: 0.0533 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0533 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0523 - val_loss: 0.0533 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0516 - val_loss: 0.0533 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0530 - val_loss: 0.0533 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0509 - val_loss: 0.0533 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 5.0435e-10
Epoch 60/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0511 - val_loss: 0.0533 - lr: 3.0590e-10
Epoch 61/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0533 - lr: 1.6788e-10
Epoch 62/100
26/26 [==============================] - 0s 17ms/step - loss: 0.0513 - val_loss: 0.0533 - lr: 9.2136e-11
Epoch 63/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0507 - val_loss: 0.0533 - lr: 5.0565e-11
Epoch 64/100
26/26 [==============================] - 0s 16ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 2.7751e-11
Epoch 1/100
34/34 [==============================] - 4s 41ms/step - loss: 0.1233 - val_loss: 0.1055 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1028 - val_loss: 0.1111 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0973 - val_loss: 0.1179 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0937 - val_loss: 0.1183 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0903 - val_loss: 0.1231 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0859 - val_loss: 0.1120 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0825 - val_loss: 0.1032 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0756 - val_loss: 0.0978 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0718 - val_loss: 0.0918 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0697 - val_loss: 0.0907 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0684 - val_loss: 0.0992 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0679 - val_loss: 0.0974 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0675 - val_loss: 0.1098 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0704 - val_loss: 0.1152 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.1200 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0835 - val_loss: 0.0991 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0797 - val_loss: 0.0886 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0742 - val_loss: 0.0900 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0742 - val_loss: 0.0881 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0728 - val_loss: 0.0839 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0679 - val_loss: 0.0790 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0660 - val_loss: 0.0759 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0652 - val_loss: 0.0738 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0642 - val_loss: 0.0718 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0611 - val_loss: 0.0721 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0617 - val_loss: 0.0711 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0702 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0604 - val_loss: 0.0702 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0600 - val_loss: 0.0699 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0600 - val_loss: 0.0697 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0599 - val_loss: 0.0697 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0584 - val_loss: 0.0697 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0593 - val_loss: 0.0693 - lr: 1.4996e-05

Epoch 35/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0595 - val_loss: 0.0693 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0593 - val_loss: 0.0692 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0602 - val_loss: 0.0691 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0691 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0592 - val_loss: 0.0691 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0594 - val_loss: 0.0691 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0597 - val_loss: 0.0691 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0690 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0691 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0602 - val_loss: 0.0690 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0601 - val_loss: 0.0690 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0603 - val_loss: 0.0690 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0595 - val_loss: 0.0690 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0595 - val_loss: 0.0690 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0597 - val_loss: 0.0690 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0588 - val_loss: 0.0690 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0591 - val_loss: 0.0690 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0593 - val_loss: 0.0690 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0589 - val_loss: 0.0690 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0598 - val_loss: 0.0690 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0586 - val_loss: 0.0690 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0690 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0600 - val_loss: 0.0690 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0587 - val_loss: 0.0690 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0590 - val_loss: 0.0690 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0597 - val_loss: 0.0690 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0599 - val_loss: 0.0690 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0594 - val_loss: 0.0690 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0596 - val_loss: 0.0690 - lr: 5.6464e-15
Epoch 1/100
43/43 [==============================] - 6s 35ms/step - loss: 0.1147 - val_loss: 0.0969 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1032 - val_loss: 0.0918 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0919 - val_loss: 0.0872 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0840 - val_loss: 0.0837 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0783 - val_loss: 0.0812 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0729 - val_loss: 0.0768 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0640 - val_loss: 0.0725 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0686 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0616 - val_loss: 0.0656 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0565 - val_loss: 0.0669 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0570 - val_loss: 0.0641 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0555 - val_loss: 0.0613 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0534 - val_loss: 0.0572 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0503 - val_loss: 0.0590 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0501 - val_loss: 0.0562 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0480 - val_loss: 0.0544 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0478 - val_loss: 0.0538 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0469 - val_loss: 0.0500 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0452 - val_loss: 0.0482 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0444 - val_loss: 0.0479 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0448 - val_loss: 0.0483 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0446 - val_loss: 0.0482 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0426 - val_loss: 0.0477 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0465 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0415 - val_loss: 0.0460 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0416 - val_loss: 0.0455 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0422 - val_loss: 0.0447 - lr: 9.0718e-05

Epoch 28/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0409 - val_loss: 0.0444 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0402 - val_loss: 0.0440 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0407 - val_loss: 0.0438 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0413 - val_loss: 0.0437 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0406 - val_loss: 0.0438 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0403 - val_loss: 0.0436 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0406 - val_loss: 0.0435 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0405 - val_loss: 0.0436 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0405 - val_loss: 0.0436 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0400 - val_loss: 0.0435 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0410 - val_loss: 0.0435 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0402 - val_loss: 0.0435 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0397 - val_loss: 0.0435 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0408 - val_loss: 0.0435 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0402 - val_loss: 0.0435 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0412 - val_loss: 0.0435 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0404 - val_loss: 0.0435 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0400 - val_loss: 0.0435 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0407 - val_loss: 0.0435 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0404 - val_loss: 0.0435 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0435 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0435 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0405 - val_loss: 0.0435 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0409 - val_loss: 0.0435 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0397 - val_loss: 0.0435 - lr: 8.3153e-10
Average Validation Loss: 0.06419765502214432
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 16, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 7s 394ms/step - loss: 0.1266 - val_loss: 0.1103 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 54ms/step - loss: 0.0915 - val_loss: 0.1213 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0946 - val_loss: 0.1298 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1048 - val_loss: 0.1295 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1009 - val_loss: 0.1234 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0960 - val_loss: 0.1127 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0895 - val_loss: 0.1009 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0822 - val_loss: 0.0961 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0747 - val_loss: 0.1009 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 53ms/step - loss: 0.0712 - val_loss: 0.1068 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0722 - val_loss: 0.1024 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0632 - val_loss: 0.0977 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0632 - val_loss: 0.0998 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0593 - val_loss: 0.1037 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0587 - val_loss: 0.1000 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0564 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0556 - val_loss: 0.1056 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0539 - val_loss: 0.1057 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0516 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0535 - val_loss: 0.1048 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 34ms/step - loss: 0.0522 - val_loss: 0.1018 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0499 - val_loss: 0.1019 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0497 - val_loss: 0.1047 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0508 - val_loss: 0.1053 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0531 - val_loss: 0.1044 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0488 - val_loss: 0.1042 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0538 - val_loss: 0.1049 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0504 - val_loss: 0.1059 - lr: 7.4274e-05
Epoch 1/100
9/9 [==============================] - 5s 142ms/step - loss: 0.1379 - val_loss: 0.1003 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1208 - val_loss: 0.0854 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1133 - val_loss: 0.0818 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1047 - val_loss: 0.0750 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1012 - val_loss: 0.0656 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0969 - val_loss: 0.0754 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0952 - val_loss: 0.0666 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0895 - val_loss: 0.0736 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0846 - val_loss: 0.0692 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0806 - val_loss: 0.0773 - lr: 0.0010

Epoch 11/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0762 - val_loss: 0.0803 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0740 - val_loss: 0.0809 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0720 - val_loss: 0.0769 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0700 - val_loss: 0.0732 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0684 - val_loss: 0.0806 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0677 - val_loss: 0.0789 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0664 - val_loss: 0.0758 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0657 - val_loss: 0.0723 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0641 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0635 - val_loss: 0.0737 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0615 - val_loss: 0.0777 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0652 - val_loss: 0.0802 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0633 - val_loss: 0.0775 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0630 - val_loss: 0.0729 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0601 - val_loss: 0.0769 - lr: 1.3534e-04
Epoch 1/100
13/13 [==============================] - 6s 100ms/step - loss: 0.2172 - val_loss: 0.1609 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1114 - val_loss: 0.1146 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1081 - val_loss: 0.1121 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1022 - val_loss: 0.1132 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0934 - val_loss: 0.1033 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0891 - val_loss: 0.0945 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0869 - val_loss: 0.0876 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0854 - val_loss: 0.0810 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0812 - val_loss: 0.0773 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0771 - val_loss: 0.0711 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0746 - val_loss: 0.0686 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0713 - val_loss: 0.0667 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 22ms/step - loss: 0.0694 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0703 - val_loss: 0.0634 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0704 - val_loss: 0.0620 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0667 - val_loss: 0.0609 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0672 - val_loss: 0.0610 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0628 - val_loss: 0.0598 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0629 - val_loss: 0.0581 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0624 - val_loss: 0.0572 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 23ms/step - loss: 0.0616 - val_loss: 0.0563 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0605 - val_loss: 0.0559 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 1s 35ms/step - loss: 0.0606 - val_loss: 0.0552 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0589 - val_loss: 0.0548 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0615 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0604 - val_loss: 0.0545 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0575 - val_loss: 0.0543 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0571 - val_loss: 0.0542 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0586 - val_loss: 0.0539 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0578 - val_loss: 0.0539 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0589 - val_loss: 0.0538 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0570 - val_loss: 0.0537 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0575 - val_loss: 0.0536 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0574 - val_loss: 0.0536 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0586 - val_loss: 0.0536 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0586 - val_loss: 0.0536 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0571 - val_loss: 0.0536 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 1s 60ms/step - loss: 0.0576 - val_loss: 0.0536 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 1s 55ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0567 - val_loss: 0.0535 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 1s 53ms/step - loss: 0.0570 - val_loss: 0.0535 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0578 - val_loss: 0.0535 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 1s 71ms/step - loss: 0.0573 - val_loss: 0.0535 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 56ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 45ms/step - loss: 0.0586 - val_loss: 0.0535 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0580 - val_loss: 0.0535 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0576 - val_loss: 0.0535 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 1s 55ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 1s 81ms/step - loss: 0.0563 - val_loss: 0.0535 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 63ms/step - loss: 0.0573 - val_loss: 0.0535 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 1s 57ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 1s 66ms/step - loss: 0.0561 - val_loss: 0.0535 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0581 - val_loss: 0.0535 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 3.7267e-09
Epoch 56/100

13/13 [==============================] - 1s 46ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0587 - val_loss: 0.0535 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0575 - val_loss: 0.0535 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0580 - val_loss: 0.0535 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0585 - val_loss: 0.0535 - lr: 2.7751e-11
Epoch 65/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0572 - val_loss: 0.0535 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0584 - val_loss: 0.0535 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0575 - val_loss: 0.0535 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0574 - val_loss: 0.0535 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 1.3816e-12
Epoch 70/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0579 - val_loss: 0.0535 - lr: 7.5826e-13
Epoch 71/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0587 - val_loss: 0.0535 - lr: 3.7654e-13
Epoch 72/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0583 - val_loss: 0.0535 - lr: 1.8698e-13
Epoch 73/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0577 - val_loss: 0.0535 - lr: 9.2853e-14
Epoch 74/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0584 - val_loss: 0.0535 - lr: 4.6110e-14
Epoch 75/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0565 - val_loss: 0.0535 - lr: 2.2897e-14
Epoch 1/100
17/17 [==============================] - 5s 114ms/step - loss: 0.1193 - val_loss: 0.1025 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1053 - val_loss: 0.0897 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0938 - val_loss: 0.0875 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 47ms/step - loss: 0.0899 - val_loss: 0.0850 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 29ms/step - loss: 0.0851 - val_loss: 0.0883 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0830 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0795 - val_loss: 0.0756 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0758 - val_loss: 0.0775 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0747 - val_loss: 0.0801 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0731 - val_loss: 0.0807 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0739 - val_loss: 0.0771 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0736 - val_loss: 0.0642 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0661 - val_loss: 0.0652 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0645 - val_loss: 0.0696 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0662 - val_loss: 0.0638 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0651 - val_loss: 0.0559 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0596 - val_loss: 0.0541 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0584 - val_loss: 0.0527 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0571 - val_loss: 0.0561 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0585 - val_loss: 0.0552 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0590 - val_loss: 0.0480 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0557 - val_loss: 0.0465 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0548 - val_loss: 0.0466 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0548 - val_loss: 0.0464 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0551 - val_loss: 0.0452 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 84ms/step - loss: 0.0533 - val_loss: 0.0451 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0533 - val_loss: 0.0450 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0527 - val_loss: 0.0444 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0520 - val_loss: 0.0441 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0526 - val_loss: 0.0442 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0525 - val_loss: 0.0439 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0530 - val_loss: 0.0440 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0528 - val_loss: 0.0439 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0528 - val_loss: 0.0440 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0525 - val_loss: 0.0439 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0509 - val_loss: 0.0439 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0512 - val_loss: 0.0439 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0520 - val_loss: 0.0439 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0525 - val_loss: 0.0438 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0438 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0529 - val_loss: 0.0438 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0520 - val_loss: 0.0438 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0515 - val_loss: 0.0438 - lr: 4.5400e-08

Epoch 51/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0527 - val_loss: 0.0438 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0510 - val_loss: 0.0438 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0519 - val_loss: 0.0438 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0438 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0522 - val_loss: 0.0438 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0515 - val_loss: 0.0438 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0516 - val_loss: 0.0438 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0438 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0526 - val_loss: 0.0438 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0534 - val_loss: 0.0438 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0529 - val_loss: 0.0438 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0527 - val_loss: 0.0438 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0534 - val_loss: 0.0438 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0531 - val_loss: 0.0438 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0438 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0518 - val_loss: 0.0438 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0530 - val_loss: 0.0438 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0523 - val_loss: 0.0438 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0518 - val_loss: 0.0438 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0533 - val_loss: 0.0438 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0530 - val_loss: 0.0438 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0528 - val_loss: 0.0438 - lr: 1.1370e-14
Epoch 1/100
22/22 [==============================] - 5s 66ms/step - loss: 0.1499 - val_loss: 0.1015 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 0s 20ms/step - loss: 0.1092 - val_loss: 0.1019 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 0s 20ms/step - loss: 0.1020 - val_loss: 0.1034 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0994 - val_loss: 0.1030 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0979 - val_loss: 0.1033 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0947 - val_loss: 0.1019 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0939 - val_loss: 0.1033 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0919 - val_loss: 0.1023 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0902 - val_loss: 0.1004 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0876 - val_loss: 0.1007 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0864 - val_loss: 0.1013 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0858 - val_loss: 0.0993 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0814 - val_loss: 0.0985 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0813 - val_loss: 0.0976 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0774 - val_loss: 0.0965 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0759 - val_loss: 0.0958 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0745 - val_loss: 0.0955 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0746 - val_loss: 0.0951 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0731 - val_loss: 0.0939 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0713 - val_loss: 0.0926 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0688 - val_loss: 0.0927 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0690 - val_loss: 0.0914 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0683 - val_loss: 0.0908 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0682 - val_loss: 0.0906 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0667 - val_loss: 0.0902 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0651 - val_loss: 0.0898 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0650 - val_loss: 0.0892 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0643 - val_loss: 0.0889 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0657 - val_loss: 0.0887 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0650 - val_loss: 0.0888 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0648 - val_loss: 0.0885 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0636 - val_loss: 0.0885 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0645 - val_loss: 0.0884 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0883 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 0s 20ms/step - loss: 0.0635 - val_loss: 0.0883 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0655 - val_loss: 0.0883 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0642 - val_loss: 0.0882 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0633 - val_loss: 0.0882 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0629 - val_loss: 0.0882 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 5.0045e-07

Epoch 45/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0646 - val_loss: 0.0882 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0635 - val_loss: 0.0882 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0629 - val_loss: 0.0882 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0644 - val_loss: 0.0882 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0645 - val_loss: 0.0882 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0634 - val_loss: 0.0882 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0635 - val_loss: 0.0882 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0654 - val_loss: 0.0882 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0641 - val_loss: 0.0882 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0647 - val_loss: 0.0882 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0882 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 0s 22ms/step - loss: 0.0637 - val_loss: 0.0882 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 0s 21ms/step - loss: 0.0639 - val_loss: 0.0882 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0638 - val_loss: 0.0882 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0643 - val_loss: 0.0882 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0640 - val_loss: 0.0882 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0642 - val_loss: 0.0882 - lr: 5.6464e-15
Average Validation Loss: 0.06944532468914985
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 153ms/step - loss: 0.2246 - val_loss: 0.2810 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.2371 - val_loss: 0.2229 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1971 - val_loss: 0.2211 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1940 - val_loss: 0.2021 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1659 - val_loss: 0.2213 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1721 - val_loss: 0.1989 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1534 - val_loss: 0.1826 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1280 - val_loss: 0.1979 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1220 - val_loss: 0.1795 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1140 - val_loss: 0.1726 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1060 - val_loss: 0.1670 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1037 - val_loss: 0.1584 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1009 - val_loss: 0.1370 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1043 - val_loss: 0.1435 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0908 - val_loss: 0.1523 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0940 - val_loss: 0.1648 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.1670 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0967 - val_loss: 0.1455 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0886 - val_loss: 0.1317 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0895 - val_loss: 0.1375 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 38ms/step - loss: 0.0862 - val_loss: 0.1536 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0868 - val_loss: 0.1341 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0808 - val_loss: 0.1438 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0834 - val_loss: 0.1358 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0812 - val_loss: 0.1406 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0813 - val_loss: 0.1365 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0801 - val_loss: 0.1358 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0793 - val_loss: 0.1337 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0804 - val_loss: 0.1347 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0800 - val_loss: 0.1401 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0804 - val_loss: 0.1391 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 43ms/step - loss: 0.0808 - val_loss: 0.1371 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 1s 41ms/step - loss: 0.0794 - val_loss: 0.1349 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0798 - val_loss: 0.1348 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0794 - val_loss: 0.1350 - lr: 1.1109e-05

Epoch 36/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0799 - val_loss: 0.1356 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0779 - val_loss: 0.1360 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0794 - val_loss: 0.1362 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0793 - val_loss: 0.1363 - lr: 3.3460e-06
Epoch 1/100
34/34 [==============================] - 6s 47ms/step - loss: 0.2527 - val_loss: 0.1762 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 25ms/step - loss: 0.2238 - val_loss: 0.1583 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1994 - val_loss: 0.1480 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1842 - val_loss: 0.1355 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1715 - val_loss: 0.1212 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1598 - val_loss: 0.1269 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1537 - val_loss: 0.1109 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1466 - val_loss: 0.1171 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1405 - val_loss: 0.1076 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1397 - val_loss: 0.1185 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1274 - val_loss: 0.1062 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1242 - val_loss: 0.1061 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1171 - val_loss: 0.1107 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1120 - val_loss: 0.1079 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1052 - val_loss: 0.1056 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1009 - val_loss: 0.1013 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0971 - val_loss: 0.0970 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0930 - val_loss: 0.0929 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0894 - val_loss: 0.0871 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0852 - val_loss: 0.0837 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0781 - val_loss: 0.0806 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0750 - val_loss: 0.0797 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0743 - val_loss: 0.0786 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0715 - val_loss: 0.0819 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0702 - val_loss: 0.0806 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0705 - val_loss: 0.0833 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0677 - val_loss: 0.0824 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0691 - val_loss: 0.0822 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0680 - val_loss: 0.0811 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0681 - val_loss: 0.0818 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0683 - val_loss: 0.0821 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0665 - val_loss: 0.0826 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0672 - val_loss: 0.0825 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0661 - val_loss: 0.0829 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0671 - val_loss: 0.0828 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0665 - val_loss: 0.0826 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0675 - val_loss: 0.0825 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0662 - val_loss: 0.0824 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0662 - val_loss: 0.0824 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0660 - val_loss: 0.0825 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 33ms/step - loss: 0.2315 - val_loss: 0.2060 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1967 - val_loss: 0.1789 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1728 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1576 - val_loss: 0.1430 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1452 - val_loss: 0.1346 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1370 - val_loss: 0.1293 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1258 - val_loss: 0.1163 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1258 - val_loss: 0.1225 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1208 - val_loss: 0.1107 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1085 - val_loss: 0.1081 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1038 - val_loss: 0.0937 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0996 - val_loss: 0.1027 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0934 - val_loss: 0.0818 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0864 - val_loss: 0.0896 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0835 - val_loss: 0.0791 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0794 - val_loss: 0.0792 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0758 - val_loss: 0.0739 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0733 - val_loss: 0.0724 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0724 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0700 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0690 - val_loss: 0.0697 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0658 - val_loss: 0.0701 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0665 - val_loss: 0.0685 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0664 - val_loss: 0.0662 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0661 - val_loss: 0.0639 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0637 - val_loss: 0.0632 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0639 - val_loss: 0.0630 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0625 - val_loss: 0.0627 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0618 - val_loss: 0.0628 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0603 - val_loss: 0.0623 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0604 - val_loss: 0.0626 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0626 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0625 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0626 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0595 - val_loss: 0.0626 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0589 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0583 - val_loss: 0.0624 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0581 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0578 - val_loss: 0.0624 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0574 - val_loss: 0.0624 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0582 - val_loss: 0.0624 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0580 - val_loss: 0.0624 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0587 - val_loss: 0.0625 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0585 - val_loss: 0.0624 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0582 - val_loss: 0.0624 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0574 - val_loss: 0.0624 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0584 - val_loss: 0.0624 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0575 - val_loss: 0.0624 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 4.5400e-08
Epoch 1/100
68/68 [==============================] - 6s 42ms/step - loss: 0.2206 - val_loss: 0.2245 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1876 - val_loss: 0.1753 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1610 - val_loss: 0.1498 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1442 - val_loss: 0.1392 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1347 - val_loss: 0.1345 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1287 - val_loss: 0.1338 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 23ms/step - loss: 0.1166 - val_loss: 0.1264 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1100 - val_loss: 0.1168 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1033 - val_loss: 0.1163 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0996 - val_loss: 0.1073 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0907 - val_loss: 0.1008 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0855 - val_loss: 0.0925 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0822 - val_loss: 0.0872 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0781 - val_loss: 0.0865 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0758 - val_loss: 0.0824 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0736 - val_loss: 0.0815 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0796 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0690 - val_loss: 0.0776 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0682 - val_loss: 0.0779 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0678 - val_loss: 0.0772 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0647 - val_loss: 0.0770 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0743 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0609 - val_loss: 0.0731 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0619 - val_loss: 0.0703 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0601 - val_loss: 0.0691 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0598 - val_loss: 0.0673 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0601 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0609 - val_loss: 0.0626 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0597 - val_loss: 0.0604 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0587 - val_loss: 0.0596 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0575 - val_loss: 0.0585 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0575 - val_loss: 0.0577 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0572 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0567 - val_loss: 0.0570 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0568 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0564 - val_loss: 0.0567 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0559 - val_loss: 0.0566 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0565 - val_loss: 0.0566 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0564 - val_loss: 0.0566 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 3.3546e-07

Epoch 46/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0552 - val_loss: 0.0565 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0560 - val_loss: 0.0565 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0555 - val_loss: 0.0565 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0555 - val_loss: 0.0565 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0566 - val_loss: 0.0565 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0553 - val_loss: 0.0565 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0559 - val_loss: 0.0565 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0554 - val_loss: 0.0565 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0566 - val_loss: 0.0565 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0562 - val_loss: 0.0565 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0564 - val_loss: 0.0565 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0558 - val_loss: 0.0565 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0556 - val_loss: 0.0565 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0565 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0563 - val_loss: 0.0565 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0557 - val_loss: 0.0565 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0565 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 7s 25ms/step - loss: 0.2231 - val_loss: 0.1888 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1754 - val_loss: 0.1594 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1499 - val_loss: 0.1458 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 21ms/step - loss: 0.1324 - val_loss: 0.1353 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1233 - val_loss: 0.1286 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1153 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1037 - val_loss: 0.1168 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0977 - val_loss: 0.1125 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0925 - val_loss: 0.1085 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0869 - val_loss: 0.1040 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0822 - val_loss: 0.1001 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0743 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0719 - val_loss: 0.0946 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0706 - val_loss: 0.0948 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0708 - val_loss: 0.0927 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0677 - val_loss: 0.0910 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0652 - val_loss: 0.0904 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0645 - val_loss: 0.0890 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0618 - val_loss: 0.0878 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0869 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0605 - val_loss: 0.0847 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0590 - val_loss: 0.0835 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0567 - val_loss: 0.0829 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0551 - val_loss: 0.0825 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0533 - val_loss: 0.0816 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0526 - val_loss: 0.0818 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0521 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0524 - val_loss: 0.0810 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0518 - val_loss: 0.0806 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0515 - val_loss: 0.0802 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0510 - val_loss: 0.0800 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0507 - val_loss: 0.0794 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0504 - val_loss: 0.0791 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0505 - val_loss: 0.0787 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0497 - val_loss: 0.0786 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0499 - val_loss: 0.0785 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0499 - val_loss: 0.0785 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0500 - val_loss: 0.0784 - lr: 4.5166e-06

Epoch 39/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0497 - val_loss: 0.0784 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0784 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0501 - val_loss: 0.0784 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0783 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0494 - val_loss: 0.0783 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0493 - val_loss: 0.0783 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0501 - val_loss: 0.0783 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0489 - val_loss: 0.0783 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0498 - val_loss: 0.0783 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0497 - val_loss: 0.0783 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0500 - val_loss: 0.0783 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0499 - val_loss: 0.0783 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0496 - val_loss: 0.0783 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0492 - val_loss: 0.0783 - lr: 1.3924e-15
Epoch 80/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0495 - val_loss: 0.0783 - lr: 6.9144e-16
Average Validation Loss: 0.08145372942090034
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 5s 152ms/step - loss: 0.2329 - val_loss: 0.2725 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2411 - val_loss: 0.2514 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 24ms/step - loss: 0.2248 - val_loss: 0.2227 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1990 - val_loss: 0.2181 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1899 - val_loss: 0.2128 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1821 - val_loss: 0.1960 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1628 - val_loss: 0.1888 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1445 - val_loss: 0.1759 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1435 - val_loss: 0.1788 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1468 - val_loss: 0.1966 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1569 - val_loss: 0.1556 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1189 - val_loss: 0.1814 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1308 - val_loss: 0.1445 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1182 - val_loss: 0.1731 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1153 - val_loss: 0.1406 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1082 - val_loss: 0.1629 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1102 - val_loss: 0.1398 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1037 - val_loss: 0.1516 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1031 - val_loss: 0.1382 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1012 - val_loss: 0.1481 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1011 - val_loss: 0.1401 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0985 - val_loss: 0.1401 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0973 - val_loss: 0.1406 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0979 - val_loss: 0.1382 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0967 - val_loss: 0.1390 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0974 - val_loss: 0.1386 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0961 - val_loss: 0.1379 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0949 - val_loss: 0.1366 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0946 - val_loss: 0.1358 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0951 - val_loss: 0.1363 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0945 - val_loss: 0.1371 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0940 - val_loss: 0.1370 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0945 - val_loss: 0.1366 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0939 - val_loss: 0.1364 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0944 - val_loss: 0.1364 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0935 - val_loss: 0.1364 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0943 - val_loss: 0.1365 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0946 - val_loss: 0.1365 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0944 - val_loss: 0.1365 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0958 - val_loss: 0.1365 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0949 - val_loss: 0.1365 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0955 - val_loss: 0.1365 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0949 - val_loss: 0.1365 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0948 - val_loss: 0.1365 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 22ms/step - loss: 0.0943 - val_loss: 0.1365 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0952 - val_loss: 0.1365 - lr: 6.7729e-08
Epoch 1/100
17/17 [==============================] - 3s 60ms/step - loss: 0.2624 - val_loss: 0.2009 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2318 - val_loss: 0.1895 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2139 - val_loss: 0.1660 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1985 - val_loss: 0.1590 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1869 - val_loss: 0.1471 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1775 - val_loss: 0.1417 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1632 - val_loss: 0.1403 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1544 - val_loss: 0.1321 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1460 - val_loss: 0.1213 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1343 - val_loss: 0.1219 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1252 - val_loss: 0.1276 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1218 - val_loss: 0.1163 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1166 - val_loss: 0.1053 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1102 - val_loss: 0.1006 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1055 - val_loss: 0.1003 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1001 - val_loss: 0.1046 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0946 - val_loss: 0.1094 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0918 - val_loss: 0.1061 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0904 - val_loss: 0.1046 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0899 - val_loss: 0.0993 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0880 - val_loss: 0.0945 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0877 - val_loss: 0.0972 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0852 - val_loss: 0.0972 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0843 - val_loss: 0.0955 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0838 - val_loss: 0.0986 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0829 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0830 - val_loss: 0.0956 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0819 - val_loss: 0.0967 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0821 - val_loss: 0.0949 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0821 - val_loss: 0.0958 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0816 - val_loss: 0.0951 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0802 - val_loss: 0.0954 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0814 - val_loss: 0.0956 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0824 - val_loss: 0.0961 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0814 - val_loss: 0.0962 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0816 - val_loss: 0.0956 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0826 - val_loss: 0.0955 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0810 - val_loss: 0.0954 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0804 - val_loss: 0.0955 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0816 - val_loss: 0.0955 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0810 - val_loss: 0.0956 - lr: 1.6616e-06
Epoch 1/100
26/26 [==============================] - 5s 52ms/step - loss: 0.2325 - val_loss: 0.2198 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 22ms/step - loss: 0.2031 - val_loss: 0.1879 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1852 - val_loss: 0.1719 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1736 - val_loss: 0.1591 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1590 - val_loss: 0.1477 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1479 - val_loss: 0.1372 - lr: 0.0010
Epoch 7/100

26/26 [==============================] - 0s 19ms/step - loss: 0.1390 - val_loss: 0.1303 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1310 - val_loss: 0.1248 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1237 - val_loss: 0.1191 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1173 - val_loss: 0.1130 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1094 - val_loss: 0.1041 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1055 - val_loss: 0.1054 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1020 - val_loss: 0.0961 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0970 - val_loss: 0.0979 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0946 - val_loss: 0.0928 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0928 - val_loss: 0.0940 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0933 - val_loss: 0.0931 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0944 - val_loss: 0.0906 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0938 - val_loss: 0.0855 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0899 - val_loss: 0.0834 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0882 - val_loss: 0.0824 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0867 - val_loss: 0.0866 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0822 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0813 - val_loss: 0.0856 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0790 - val_loss: 0.0846 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0785 - val_loss: 0.0846 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0778 - val_loss: 0.0826 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0776 - val_loss: 0.0844 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0771 - val_loss: 0.0828 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0773 - val_loss: 0.0830 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0768 - val_loss: 0.0830 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 19ms/step - loss: 0.0770 - val_loss: 0.0828 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0770 - val_loss: 0.0828 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0762 - val_loss: 0.0827 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0763 - val_loss: 0.0824 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0761 - val_loss: 0.0826 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 18ms/step - loss: 0.0761 - val_loss: 0.0825 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0768 - val_loss: 0.0825 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0760 - val_loss: 0.0825 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0764 - val_loss: 0.0825 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0759 - val_loss: 0.0825 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 7s 63ms/step - loss: 0.2303 - val_loss: 0.2000 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1880 - val_loss: 0.1938 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1674 - val_loss: 0.1736 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 2s 53ms/step - loss: 0.1473 - val_loss: 0.1498 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1330 - val_loss: 0.1324 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 2s 54ms/step - loss: 0.1208 - val_loss: 0.1226 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 2s 53ms/step - loss: 0.1118 - val_loss: 0.1138 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 42ms/step - loss: 0.1042 - val_loss: 0.1064 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0991 - val_loss: 0.1008 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0926 - val_loss: 0.0922 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0880 - val_loss: 0.0944 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0857 - val_loss: 0.0913 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0821 - val_loss: 0.0902 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0801 - val_loss: 0.0872 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0772 - val_loss: 0.0866 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0780 - val_loss: 0.0914 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0867 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0968 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0746 - val_loss: 0.0979 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0744 - val_loss: 0.0960 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0769 - val_loss: 0.1046 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0836 - val_loss: 0.0929 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0802 - val_loss: 0.0786 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0754 - val_loss: 0.0744 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0736 - val_loss: 0.0714 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0725 - val_loss: 0.0683 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0707 - val_loss: 0.0678 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0703 - val_loss: 0.0669 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0690 - val_loss: 0.0668 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0687 - val_loss: 0.0662 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0679 - val_loss: 0.0661 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0675 - val_loss: 0.0659 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0673 - val_loss: 0.0657 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0672 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0676 - val_loss: 0.0655 - lr: 1.1109e-05
Epoch 36/100

34/34 [==============================] - 1s 24ms/step - loss: 0.0671 - val_loss: 0.0655 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0672 - val_loss: 0.0655 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0666 - val_loss: 0.0655 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0668 - val_loss: 0.0654 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0665 - val_loss: 0.0654 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0664 - val_loss: 0.0654 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0672 - val_loss: 0.0654 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0659 - val_loss: 0.0654 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0673 - val_loss: 0.0654 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0662 - val_loss: 0.0654 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0667 - val_loss: 0.0654 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0671 - val_loss: 0.0654 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0672 - val_loss: 0.0654 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0666 - val_loss: 0.0654 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0664 - val_loss: 0.0654 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0669 - val_loss: 0.0654 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0665 - val_loss: 0.0654 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0670 - val_loss: 0.0654 - lr: 2.5175e-12
Epoch 1/100
43/43 [==============================] - 4s 35ms/step - loss: 0.2421 - val_loss: 0.2057 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1919 - val_loss: 0.1806 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1638 - val_loss: 0.1632 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1458 - val_loss: 0.1520 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 16ms/step - loss: 0.1350 - val_loss: 0.1448 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1242 - val_loss: 0.1373 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1136 - val_loss: 0.1309 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 27ms/step - loss: 0.1071 - val_loss: 0.1255 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0989 - val_loss: 0.1203 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0961 - val_loss: 0.1168 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0930 - val_loss: 0.1126 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 16ms/step - loss: 0.0859 - val_loss: 0.1123 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0862 - val_loss: 0.1080 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0834 - val_loss: 0.1091 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0877 - val_loss: 0.1114 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0847 - val_loss: 0.1044 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0806 - val_loss: 0.1012 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0775 - val_loss: 0.0985 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0741 - val_loss: 0.0958 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0707 - val_loss: 0.0948 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0685 - val_loss: 0.0931 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0675 - val_loss: 0.0927 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0656 - val_loss: 0.0922 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0643 - val_loss: 0.0912 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0645 - val_loss: 0.0910 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0638 - val_loss: 0.0906 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0645 - val_loss: 0.0905 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0639 - val_loss: 0.0905 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0642 - val_loss: 0.0894 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0632 - val_loss: 0.0886 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0627 - val_loss: 0.0877 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0616 - val_loss: 0.0871 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0869 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0616 - val_loss: 0.0867 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0611 - val_loss: 0.0865 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0611 - val_loss: 0.0864 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0864 - lr: 6.0967e-06

Epoch 38/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0607 - val_loss: 0.0863 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0606 - val_loss: 0.0863 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0612 - val_loss: 0.0862 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0613 - val_loss: 0.0862 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0612 - val_loss: 0.0862 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0611 - val_loss: 0.0862 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0613 - val_loss: 0.0862 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0603 - val_loss: 0.0862 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0862 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0609 - val_loss: 0.0862 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0862 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0603 - val_loss: 0.0862 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0862 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0862 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0605 - val_loss: 0.0862 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0606 - val_loss: 0.0862 - lr: 1.1370e-14
Average Validation Loss: 0.09285216629505158
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 5s 212ms/step - loss: 0.2456 - val_loss: 0.2663 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 39ms/step - loss: 0.2387 - val_loss: 0.2695 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 32ms/step - loss: 0.2362 - val_loss: 0.2598 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 35ms/step - loss: 0.2275 - val_loss: 0.2457 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 36ms/step - loss: 0.2122 - val_loss: 0.2352 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 32ms/step - loss: 0.2063 - val_loss: 0.2304 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 34ms/step - loss: 0.2054 - val_loss: 0.2288 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1974 - val_loss: 0.2289 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1914 - val_loss: 0.2281 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1897 - val_loss: 0.2240 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1831 - val_loss: 0.2182 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1786 - val_loss: 0.2122 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1696 - val_loss: 0.2076 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1665 - val_loss: 0.2055 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1640 - val_loss: 0.2033 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1569 - val_loss: 0.2008 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1526 - val_loss: 0.1934 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1470 - val_loss: 0.1917 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1418 - val_loss: 0.1942 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1398 - val_loss: 0.1905 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1341 - val_loss: 0.1900 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1315 - val_loss: 0.1864 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1275 - val_loss: 0.1885 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1279 - val_loss: 0.1911 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1288 - val_loss: 0.1871 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1259 - val_loss: 0.1869 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1251 - val_loss: 0.1869 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1235 - val_loss: 0.1873 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1247 - val_loss: 0.1862 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1239 - val_loss: 0.1867 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1232 - val_loss: 0.1867 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1232 - val_loss: 0.1862 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1232 - val_loss: 0.1861 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1232 - val_loss: 0.1861 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1228 - val_loss: 0.1861 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1237 - val_loss: 0.1861 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1229 - val_loss: 0.1862 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1226 - val_loss: 0.1862 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1224 - val_loss: 0.1863 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1229 - val_loss: 0.1863 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1236 - val_loss: 0.1863 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1229 - val_loss: 0.1862 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1245 - val_loss: 0.1862 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1218 - val_loss: 0.1862 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 32ms/step - loss: 0.1216 - val_loss: 0.1862 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1248 - val_loss: 0.1862 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1227 - val_loss: 0.1862 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1217 - val_loss: 0.1862 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 34ms/step - loss: 0.1233 - val_loss: 0.1862 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1226 - val_loss: 0.1862 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1223 - val_loss: 0.1862 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 33ms/step - loss: 0.1225 - val_loss: 0.1862 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 35ms/step - loss: 0.1224 - val_loss: 0.1862 - lr: 1.0130e-08
Epoch 1/100
9/9 [==============================] - 4s 151ms/step - loss: 0.2693 - val_loss: 0.2118 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2427 - val_loss: 0.1966 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 32ms/step - loss: 0.2246 - val_loss: 0.2070 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 37ms/step - loss: 0.2121 - val_loss: 0.1748 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.2008 - val_loss: 0.1788 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1890 - val_loss: 0.1756 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1768 - val_loss: 0.1744 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1694 - val_loss: 0.1736 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1611 - val_loss: 0.1648 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1544 - val_loss: 0.1543 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1464 - val_loss: 0.1567 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1425 - val_loss: 0.1485 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1334 - val_loss: 0.1472 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1298 - val_loss: 0.1403 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1255 - val_loss: 0.1372 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1244 - val_loss: 0.1304 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1202 - val_loss: 0.1328 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1175 - val_loss: 0.1305 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1167 - val_loss: 0.1259 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1141 - val_loss: 0.1228 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1116 - val_loss: 0.1235 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1104 - val_loss: 0.1212 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1090 - val_loss: 0.1217 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1083 - val_loss: 0.1170 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1067 - val_loss: 0.1218 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1078 - val_loss: 0.1198 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1072 - val_loss: 0.1170 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1068 - val_loss: 0.1170 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1069 - val_loss: 0.1172 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1065 - val_loss: 0.1184 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1061 - val_loss: 0.1175 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1065 - val_loss: 0.1167 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1066 - val_loss: 0.1159 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1045 - val_loss: 0.1162 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.1160 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1161 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1052 - val_loss: 0.1163 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1047 - val_loss: 0.1164 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1059 - val_loss: 0.1164 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.1165 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1055 - val_loss: 0.1165 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1049 - val_loss: 0.1165 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1061 - val_loss: 0.1165 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1044 - val_loss: 0.1165 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1059 - val_loss: 0.1165 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1059 - val_loss: 0.1165 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.5073e-07
Epoch 48/100

9/9 [==============================] - 0s 33ms/step - loss: 0.1050 - val_loss: 0.1165 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1051 - val_loss: 0.1165 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1040 - val_loss: 0.1165 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1058 - val_loss: 0.1165 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.6702e-08
Epoch 53/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1056 - val_loss: 0.1165 - lr: 1.0130e-08
Epoch 1/100
13/13 [==============================] - 4s 83ms/step - loss: 0.2762 - val_loss: 0.2401 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 23ms/step - loss: 0.2293 - val_loss: 0.2317 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.2092 - val_loss: 0.2147 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1908 - val_loss: 0.1893 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1773 - val_loss: 0.1680 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1678 - val_loss: 0.1576 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 23ms/step - loss: 0.1560 - val_loss: 0.1540 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1480 - val_loss: 0.1489 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1416 - val_loss: 0.1412 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1338 - val_loss: 0.1327 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1311 - val_loss: 0.1318 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1228 - val_loss: 0.1245 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1176 - val_loss: 0.1195 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1150 - val_loss: 0.1160 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1105 - val_loss: 0.1133 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1063 - val_loss: 0.1090 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1023 - val_loss: 0.1046 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1031 - val_loss: 0.1024 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1013 - val_loss: 0.1028 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0983 - val_loss: 0.1022 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0946 - val_loss: 0.1000 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0935 - val_loss: 0.0965 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0932 - val_loss: 0.0967 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0913 - val_loss: 0.0955 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0909 - val_loss: 0.0960 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0899 - val_loss: 0.0949 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0895 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0892 - val_loss: 0.0943 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0885 - val_loss: 0.0931 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0886 - val_loss: 0.0939 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0876 - val_loss: 0.0931 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0932 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0880 - val_loss: 0.0931 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0930 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0877 - val_loss: 0.0931 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0884 - val_loss: 0.0932 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0874 - val_loss: 0.0931 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0878 - val_loss: 0.0930 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0873 - val_loss: 0.0930 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.0930 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0879 - val_loss: 0.0929 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0929 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0887 - val_loss: 0.0929 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0878 - val_loss: 0.0929 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0867 - val_loss: 0.0929 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0877 - val_loss: 0.0929 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0871 - val_loss: 0.0929 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0873 - val_loss: 0.0929 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0869 - val_loss: 0.0929 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0862 - val_loss: 0.0929 - lr: 5.0435e-10
Epoch 60/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 3.0590e-10
Epoch 61/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0869 - val_loss: 0.0929 - lr: 1.6788e-10
Epoch 62/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0875 - val_loss: 0.0929 - lr: 9.2136e-11
Epoch 63/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0878 - val_loss: 0.0929 - lr: 5.0565e-11
Epoch 64/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0872 - val_loss: 0.0929 - lr: 2.7751e-11
Epoch 65/100

13/13 [==============================] - 0s 25ms/step - loss: 0.0876 - val_loss: 0.0929 - lr: 1.5230e-11
Epoch 66/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0876 - val_loss: 0.0929 - lr: 8.3584e-12
Epoch 67/100
13/13 [==============================] - 0s 24ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 4.5872e-12
Epoch 68/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0882 - val_loss: 0.0929 - lr: 2.5175e-12
Epoch 69/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0929 - lr: 1.3816e-12
Epoch 1/100
17/17 [==============================] - 5s 113ms/step - loss: 0.2459 - val_loss: 0.2214 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 30ms/step - loss: 0.2187 - val_loss: 0.2050 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1957 - val_loss: 0.1905 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1791 - val_loss: 0.2096 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1758 - val_loss: 0.2173 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1744 - val_loss: 0.1511 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1459 - val_loss: 0.1541 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1372 - val_loss: 0.1657 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1305 - val_loss: 0.1577 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1287 - val_loss: 0.1735 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1403 - val_loss: 0.1421 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1297 - val_loss: 0.1130 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1097 - val_loss: 0.1339 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1110 - val_loss: 0.1354 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1158 - val_loss: 0.1219 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 30ms/step - loss: 0.1128 - val_loss: 0.0956 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0958 - val_loss: 0.0962 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0925 - val_loss: 0.1041 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0931 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0961 - val_loss: 0.1041 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0970 - val_loss: 0.0847 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0892 - val_loss: 0.0828 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0870 - val_loss: 0.0820 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0853 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0847 - val_loss: 0.0808 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0807 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0844 - val_loss: 0.0802 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0838 - val_loss: 0.0795 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0834 - val_loss: 0.0794 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0831 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0824 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0828 - val_loss: 0.0787 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0829 - val_loss: 0.0788 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0830 - val_loss: 0.0787 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0825 - val_loss: 0.0786 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0826 - val_loss: 0.0786 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0821 - val_loss: 0.0786 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0820 - val_loss: 0.0786 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0833 - val_loss: 0.0785 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0819 - val_loss: 0.0785 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0820 - val_loss: 0.0785 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0814 - val_loss: 0.0785 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0833 - val_loss: 0.0785 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0830 - val_loss: 0.0785 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0785 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0817 - val_loss: 0.0785 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0818 - val_loss: 0.0785 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0832 - val_loss: 0.0785 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0829 - val_loss: 0.0785 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0825 - val_loss: 0.0785 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 1.5230e-11

Epoch 66/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0824 - val_loss: 0.0785 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0822 - val_loss: 0.0785 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0823 - val_loss: 0.0785 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0826 - val_loss: 0.0785 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0821 - val_loss: 0.0785 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0818 - val_loss: 0.0785 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0822 - val_loss: 0.0785 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0827 - val_loss: 0.0785 - lr: 2.2897e-14
Epoch 1/100
22/22 [==============================] - 4s 70ms/step - loss: 0.2482 - val_loss: 0.2196 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.2137 - val_loss: 0.2052 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1935 - val_loss: 0.1897 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1790 - val_loss: 0.1783 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1670 - val_loss: 0.1668 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1552 - val_loss: 0.1575 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1452 - val_loss: 0.1505 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1404 - val_loss: 0.1453 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1340 - val_loss: 0.1398 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1279 - val_loss: 0.1353 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1233 - val_loss: 0.1319 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1168 - val_loss: 0.1271 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1117 - val_loss: 0.1226 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 23ms/step - loss: 0.1089 - val_loss: 0.1221 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 0s 23ms/step - loss: 0.1063 - val_loss: 0.1212 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1020 - val_loss: 0.1168 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0977 - val_loss: 0.1128 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0950 - val_loss: 0.1124 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0918 - val_loss: 0.1090 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0887 - val_loss: 0.1061 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0862 - val_loss: 0.1036 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0826 - val_loss: 0.1029 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0816 - val_loss: 0.0979 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0794 - val_loss: 0.0940 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0765 - val_loss: 0.0890 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0749 - val_loss: 0.0864 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0732 - val_loss: 0.0862 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0734 - val_loss: 0.0851 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0728 - val_loss: 0.0845 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0726 - val_loss: 0.0845 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0724 - val_loss: 0.0844 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0723 - val_loss: 0.0840 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0723 - val_loss: 0.0838 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0724 - val_loss: 0.0837 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0713 - val_loss: 0.0836 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0836 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0835 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0835 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0727 - val_loss: 0.0835 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0722 - val_loss: 0.0834 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0715 - val_loss: 0.0834 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0721 - val_loss: 0.0834 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0722 - val_loss: 0.0834 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0719 - val_loss: 0.0834 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0725 - val_loss: 0.0834 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0723 - val_loss: 0.0834 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0834 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0716 - val_loss: 0.0834 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0717 - val_loss: 0.0834 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 23ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0718 - val_loss: 0.0834 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0714 - val_loss: 0.0834 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0715 - val_loss: 0.0834 - lr: 3.0590e-10

Epoch 61/100
22/22 [==============================] - 0s 23ms/step - loss: 0.0721 - val_loss: 0.0834 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0720 - val_loss: 0.0834 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0719 - val_loss: 0.0834 - lr: 5.0565e-11
Average Validation Loss: 0.11137318760156631
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 62ms/step - loss: 0.2260 - val_loss: 0.2699 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 17ms/step - loss: 0.2333 - val_loss: 0.2148 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1932 - val_loss: 0.2075 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1897 - val_loss: 0.1951 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1690 - val_loss: 0.1951 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1687 - val_loss: 0.1765 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1314 - val_loss: 0.2186 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1643 - val_loss: 0.1603 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1221 - val_loss: 0.1527 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1154 - val_loss: 0.1550 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1107 - val_loss: 0.1383 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1019 - val_loss: 0.1461 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1006 - val_loss: 0.1618 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0989 - val_loss: 0.1547 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0922 - val_loss: 0.1314 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0893 - val_loss: 0.1371 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0868 - val_loss: 0.1447 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0881 - val_loss: 0.1275 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0861 - val_loss: 0.1316 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0833 - val_loss: 0.1408 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0846 - val_loss: 0.1299 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0798 - val_loss: 0.1297 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0820 - val_loss: 0.1347 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0794 - val_loss: 0.1278 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0779 - val_loss: 0.1325 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0787 - val_loss: 0.1289 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0768 - val_loss: 0.1289 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0772 - val_loss: 0.1282 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0775 - val_loss: 0.1286 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0771 - val_loss: 0.1290 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0781 - val_loss: 0.1285 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0767 - val_loss: 0.1270 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0762 - val_loss: 0.1264 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1272 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0766 - val_loss: 0.1268 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1272 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0762 - val_loss: 0.1272 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0763 - val_loss: 0.1270 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0757 - val_loss: 0.1271 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0763 - val_loss: 0.1270 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1268 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0750 - val_loss: 0.1267 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0763 - val_loss: 0.1268 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1268 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0765 - val_loss: 0.1268 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0772 - val_loss: 0.1267 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0772 - val_loss: 0.1267 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0777 - val_loss: 0.1267 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0760 - val_loss: 0.1267 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0762 - val_loss: 0.1267 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0769 - val_loss: 0.1267 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0767 - val_loss: 0.1267 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0759 - val_loss: 0.1267 - lr: 1.0130e-08
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.2270 - val_loss: 0.1878 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 16ms/step - loss: 0.2100 - val_loss: 0.1494 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1900 - val_loss: 0.1465 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1766 - val_loss: 0.1223 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1633 - val_loss: 0.1267 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1554 - val_loss: 0.1071 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1470 - val_loss: 0.1180 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 11ms/step - loss: 0.1408 - val_loss: 0.0967 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1382 - val_loss: 0.1205 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1290 - val_loss: 0.0897 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 12ms/step - loss: 0.1255 - val_loss: 0.1236 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1116 - val_loss: 0.1153 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1092 - val_loss: 0.0901 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1096 - val_loss: 0.1003 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1014 - val_loss: 0.1028 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1032 - val_loss: 0.0875 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0960 - val_loss: 0.0835 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0898 - val_loss: 0.0785 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0877 - val_loss: 0.0776 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0826 - val_loss: 0.0763 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 11ms/step - loss: 0.0787 - val_loss: 0.0763 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0754 - val_loss: 0.0746 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0731 - val_loss: 0.0754 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 11ms/step - loss: 0.0714 - val_loss: 0.0775 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0708 - val_loss: 0.0802 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0675 - val_loss: 0.0783 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0672 - val_loss: 0.0802 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0681 - val_loss: 0.0796 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0660 - val_loss: 0.0802 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0650 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0656 - val_loss: 0.0789 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0656 - val_loss: 0.0800 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0662 - val_loss: 0.0799 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0657 - val_loss: 0.0804 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0657 - val_loss: 0.0800 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0641 - val_loss: 0.0802 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0650 - val_loss: 0.0803 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0803 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0645 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0649 - val_loss: 0.0803 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0650 - val_loss: 0.0803 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 12ms/step - loss: 0.0651 - val_loss: 0.0803 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 5s 36ms/step - loss: 0.2191 - val_loss: 0.1957 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1868 - val_loss: 0.1666 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1675 - val_loss: 0.1510 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 16ms/step - loss: 0.1515 - val_loss: 0.1372 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1421 - val_loss: 0.1285 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1360 - val_loss: 0.1239 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1298 - val_loss: 0.1205 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1254 - val_loss: 0.1150 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1191 - val_loss: 0.1059 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 14ms/step - loss: 0.1180 - val_loss: 0.1081 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 14ms/step - loss: 0.1065 - val_loss: 0.0920 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1074 - val_loss: 0.0970 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0937 - val_loss: 0.0818 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0975 - val_loss: 0.0911 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0858 - val_loss: 0.0764 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0808 - val_loss: 0.0728 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0772 - val_loss: 0.0708 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0728 - val_loss: 0.0667 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0688 - val_loss: 0.0657 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0671 - val_loss: 0.0647 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0637 - val_loss: 0.0630 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0615 - val_loss: 0.0627 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0610 - val_loss: 0.0619 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0608 - val_loss: 0.0618 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0605 - val_loss: 0.0603 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0613 - val_loss: 0.0597 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0597 - val_loss: 0.0597 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 15ms/step - loss: 0.0599 - val_loss: 0.0614 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0584 - val_loss: 0.0609 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0578 - val_loss: 0.0616 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0566 - val_loss: 0.0621 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0564 - val_loss: 0.0621 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0561 - val_loss: 0.0623 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0559 - val_loss: 0.0621 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0556 - val_loss: 0.0618 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0550 - val_loss: 0.0617 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0620 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0553 - val_loss: 0.0621 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 16ms/step - loss: 0.0552 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0620 - lr: 2.4788e-06

Epoch 41/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0560 - val_loss: 0.0620 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0552 - val_loss: 0.0620 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0555 - val_loss: 0.0621 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0556 - val_loss: 0.0621 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 14ms/step - loss: 0.0557 - val_loss: 0.0621 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 1s 13ms/step - loss: 0.0562 - val_loss: 0.0621 - lr: 2.2487e-07
Epoch 1/100
68/68 [==============================] - 4s 24ms/step - loss: 0.2143 - val_loss: 0.2137 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1796 - val_loss: 0.1816 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1553 - val_loss: 0.1707 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1457 - val_loss: 0.1525 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1309 - val_loss: 0.1387 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1244 - val_loss: 0.1364 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 13ms/step - loss: 0.1163 - val_loss: 0.1228 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 26ms/step - loss: 0.1082 - val_loss: 0.1324 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1024 - val_loss: 0.1375 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0986 - val_loss: 0.1224 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0923 - val_loss: 0.1148 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0866 - val_loss: 0.0998 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0820 - val_loss: 0.0944 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0781 - val_loss: 0.0915 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0742 - val_loss: 0.0882 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0731 - val_loss: 0.0864 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0703 - val_loss: 0.0845 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0698 - val_loss: 0.0822 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0661 - val_loss: 0.0805 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0662 - val_loss: 0.0810 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0648 - val_loss: 0.0801 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0629 - val_loss: 0.0830 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0627 - val_loss: 0.0809 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0628 - val_loss: 0.0844 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0642 - val_loss: 0.0800 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0639 - val_loss: 0.0766 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0636 - val_loss: 0.0718 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0624 - val_loss: 0.0685 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0625 - val_loss: 0.0655 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0601 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0600 - val_loss: 0.0628 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0587 - val_loss: 0.0626 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0588 - val_loss: 0.0624 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0588 - val_loss: 0.0622 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0621 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0576 - val_loss: 0.0620 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0580 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0580 - val_loss: 0.0618 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0618 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0581 - val_loss: 0.0618 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0578 - val_loss: 0.0618 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0580 - val_loss: 0.0618 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0572 - val_loss: 0.0618 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0580 - val_loss: 0.0617 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0617 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0571 - val_loss: 0.0617 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0581 - val_loss: 0.0617 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0576 - val_loss: 0.0617 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0580 - val_loss: 0.0617 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0617 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0581 - val_loss: 0.0617 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0583 - val_loss: 0.0617 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 2.7751e-11

Epoch 65/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0574 - val_loss: 0.0617 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0575 - val_loss: 0.0617 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0571 - val_loss: 0.0617 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0582 - val_loss: 0.0617 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 14ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 13ms/step - loss: 0.0569 - val_loss: 0.0617 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0579 - val_loss: 0.0617 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0572 - val_loss: 0.0617 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0568 - val_loss: 0.0617 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0577 - val_loss: 0.0617 - lr: 5.6464e-15
Epoch 1/100
85/85 [==============================] - 5s 23ms/step - loss: 0.2082 - val_loss: 0.1724 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1608 - val_loss: 0.1424 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 15ms/step - loss: 0.1405 - val_loss: 0.1301 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 14ms/step - loss: 0.1280 - val_loss: 0.1218 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1192 - val_loss: 0.1169 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1087 - val_loss: 0.1108 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 13ms/step - loss: 0.1047 - val_loss: 0.1078 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0993 - val_loss: 0.1040 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0924 - val_loss: 0.1041 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0915 - val_loss: 0.0953 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0839 - val_loss: 0.0912 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0755 - val_loss: 0.0878 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0718 - val_loss: 0.0838 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0687 - val_loss: 0.0813 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0656 - val_loss: 0.0794 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0640 - val_loss: 0.0791 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0643 - val_loss: 0.0764 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0608 - val_loss: 0.0737 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0588 - val_loss: 0.0721 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0560 - val_loss: 0.0718 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0555 - val_loss: 0.0701 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0528 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0511 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0497 - val_loss: 0.0660 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0490 - val_loss: 0.0656 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0473 - val_loss: 0.0651 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0476 - val_loss: 0.0645 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0466 - val_loss: 0.0643 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0462 - val_loss: 0.0639 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0459 - val_loss: 0.0639 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0458 - val_loss: 0.0635 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0458 - val_loss: 0.0630 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0628 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0449 - val_loss: 0.0626 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0452 - val_loss: 0.0625 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0624 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0452 - val_loss: 0.0624 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0453 - val_loss: 0.0623 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0454 - val_loss: 0.0622 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0622 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0622 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0622 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0457 - val_loss: 0.0621 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0446 - val_loss: 0.0621 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0449 - val_loss: 0.0621 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 1.3710e-09

Epoch 58/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0453 - val_loss: 0.0621 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0453 - val_loss: 0.0621 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 3s 37ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0445 - val_loss: 0.0621 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0451 - val_loss: 0.0621 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 3s 34ms/step - loss: 0.0452 - val_loss: 0.0621 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0447 - val_loss: 0.0621 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0448 - val_loss: 0.0621 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0446 - val_loss: 0.0621 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0450 - val_loss: 0.0621 - lr: 1.1370e-14
Average Validation Loss: 0.07689967826008796
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 133ms/step - loss: 0.2231 - val_loss: 0.2408 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2169 - val_loss: 0.2400 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.2081 - val_loss: 0.2202 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1950 - val_loss: 0.2126 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1854 - val_loss: 0.2075 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1799 - val_loss: 0.2016 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1715 - val_loss: 0.1949 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1624 - val_loss: 0.1824 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1454 - val_loss: 0.1713 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1300 - val_loss: 0.1599 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1221 - val_loss: 0.1651 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1236 - val_loss: 0.1745 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1283 - val_loss: 0.1464 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1078 - val_loss: 0.1533 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1098 - val_loss: 0.1538 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1083 - val_loss: 0.1414 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1014 - val_loss: 0.1462 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1013 - val_loss: 0.1453 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0982 - val_loss: 0.1415 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0970 - val_loss: 0.1419 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0994 - val_loss: 0.1403 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0957 - val_loss: 0.1407 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0952 - val_loss: 0.1388 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0959 - val_loss: 0.1369 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0936 - val_loss: 0.1364 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0930 - val_loss: 0.1399 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.1376 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0928 - val_loss: 0.1364 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0935 - val_loss: 0.1365 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0919 - val_loss: 0.1375 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0932 - val_loss: 0.1379 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0913 - val_loss: 0.1380 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0930 - val_loss: 0.1375 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0916 - val_loss: 0.1375 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0928 - val_loss: 0.1373 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0930 - val_loss: 0.1372 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0917 - val_loss: 0.1370 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0921 - val_loss: 0.1368 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0918 - val_loss: 0.1367 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0937 - val_loss: 0.1366 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0918 - val_loss: 0.1366 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0925 - val_loss: 0.1366 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0933 - val_loss: 0.1366 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0918 - val_loss: 0.1366 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0927 - val_loss: 0.1365 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0928 - val_loss: 0.1365 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0932 - val_loss: 0.1365 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0919 - val_loss: 0.1365 - lr: 1.0104e-07
Epoch 1/100
17/17 [==============================] - 4s 62ms/step - loss: 0.2738 - val_loss: 0.1894 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 17ms/step - loss: 0.2233 - val_loss: 0.1786 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.2073 - val_loss: 0.1622 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1928 - val_loss: 0.1520 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1815 - val_loss: 0.1485 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1733 - val_loss: 0.1342 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1607 - val_loss: 0.1349 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1458 - val_loss: 0.1414 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1450 - val_loss: 0.1138 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1362 - val_loss: 0.1247 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1224 - val_loss: 0.1313 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1296 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1228 - val_loss: 0.1060 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1079 - val_loss: 0.1208 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1048 - val_loss: 0.1114 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1062 - val_loss: 0.1019 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1012 - val_loss: 0.1001 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0953 - val_loss: 0.1018 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0930 - val_loss: 0.1020 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0938 - val_loss: 0.0966 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0910 - val_loss: 0.0975 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0891 - val_loss: 0.0967 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0874 - val_loss: 0.0977 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0870 - val_loss: 0.0980 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0870 - val_loss: 0.0958 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0856 - val_loss: 0.0988 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0856 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0857 - val_loss: 0.0966 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0847 - val_loss: 0.0970 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0849 - val_loss: 0.0968 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0853 - val_loss: 0.0968 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0851 - val_loss: 0.0977 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0840 - val_loss: 0.0973 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0837 - val_loss: 0.0966 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0848 - val_loss: 0.0966 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0845 - val_loss: 0.0970 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0854 - val_loss: 0.0967 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0839 - val_loss: 0.0967 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0841 - val_loss: 0.0968 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0843 - val_loss: 0.0967 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0837 - val_loss: 0.0967 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0838 - val_loss: 0.0967 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0845 - val_loss: 0.0967 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0840 - val_loss: 0.0968 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0842 - val_loss: 0.0968 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 5s 54ms/step - loss: 0.2245 - val_loss: 0.2163 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1993 - val_loss: 0.1924 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1793 - val_loss: 0.1748 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 29ms/step - loss: 0.1654 - val_loss: 0.1552 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1543 - val_loss: 0.1447 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1451 - val_loss: 0.1354 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1348 - val_loss: 0.1305 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1263 - val_loss: 0.1214 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1201 - val_loss: 0.1194 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1098 - val_loss: 0.0997 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1070 - val_loss: 0.1082 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0987 - val_loss: 0.0945 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0936 - val_loss: 0.0929 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0882 - val_loss: 0.0861 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0865 - val_loss: 0.0875 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0822 - val_loss: 0.0818 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0811 - val_loss: 0.0847 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0798 - val_loss: 0.0822 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0795 - val_loss: 0.0831 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0793 - val_loss: 0.0824 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0784 - val_loss: 0.0807 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0799 - val_loss: 0.0780 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0784 - val_loss: 0.0787 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0753 - val_loss: 0.0790 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0746 - val_loss: 0.0782 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0728 - val_loss: 0.0786 - lr: 1.1080e-04
Epoch 27/100

26/26 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0781 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0708 - val_loss: 0.0774 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0702 - val_loss: 0.0776 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0710 - val_loss: 0.0770 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0707 - val_loss: 0.0776 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0705 - val_loss: 0.0769 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0700 - val_loss: 0.0769 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0696 - val_loss: 0.0770 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0700 - val_loss: 0.0769 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0700 - val_loss: 0.0770 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0697 - val_loss: 0.0771 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0699 - val_loss: 0.0772 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0772 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0692 - val_loss: 0.0771 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0693 - val_loss: 0.0771 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0696 - val_loss: 0.0771 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0688 - val_loss: 0.0770 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0694 - val_loss: 0.0770 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0697 - val_loss: 0.0770 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0705 - val_loss: 0.0770 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0704 - val_loss: 0.0770 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0691 - val_loss: 0.0770 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0694 - val_loss: 0.0770 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0693 - val_loss: 0.0770 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0695 - val_loss: 0.0770 - lr: 1.0130e-08
Epoch 1/100
34/34 [==============================] - 5s 47ms/step - loss: 0.2209 - val_loss: 0.1964 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1882 - val_loss: 0.1942 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1712 - val_loss: 0.1689 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1542 - val_loss: 0.1541 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1415 - val_loss: 0.1461 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1307 - val_loss: 0.1383 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1232 - val_loss: 0.1384 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1168 - val_loss: 0.1278 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1106 - val_loss: 0.1205 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1063 - val_loss: 0.1188 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.1103 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0938 - val_loss: 0.1044 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0916 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0885 - val_loss: 0.1041 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0859 - val_loss: 0.0999 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0840 - val_loss: 0.1049 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0835 - val_loss: 0.1052 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0832 - val_loss: 0.1099 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0838 - val_loss: 0.1089 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0867 - val_loss: 0.1256 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0986 - val_loss: 0.1041 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0916 - val_loss: 0.0904 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0843 - val_loss: 0.0863 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0833 - val_loss: 0.0789 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0801 - val_loss: 0.0751 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0772 - val_loss: 0.0725 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0706 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0751 - val_loss: 0.0693 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0734 - val_loss: 0.0684 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0737 - val_loss: 0.0674 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0721 - val_loss: 0.0669 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0722 - val_loss: 0.0667 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0715 - val_loss: 0.0665 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0664 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0711 - val_loss: 0.0661 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0715 - val_loss: 0.0660 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0708 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0711 - val_loss: 0.0659 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0659 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 7.4659e-07

Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0705 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0701 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0704 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0707 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0699 - val_loss: 0.0658 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0716 - val_loss: 0.0658 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0701 - val_loss: 0.0658 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0712 - val_loss: 0.0658 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0706 - val_loss: 0.0658 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0658 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0702 - val_loss: 0.0658 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0709 - val_loss: 0.0658 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0703 - val_loss: 0.0658 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0713 - val_loss: 0.0658 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0658 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0708 - val_loss: 0.0658 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0704 - val_loss: 0.0658 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0702 - val_loss: 0.0658 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 4s 39ms/step - loss: 0.2130 - val_loss: 0.1923 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 21ms/step - loss: 0.1767 - val_loss: 0.1724 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1543 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1364 - val_loss: 0.1445 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 27ms/step - loss: 0.1233 - val_loss: 0.1384 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1178 - val_loss: 0.1312 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1105 - val_loss: 0.1273 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1035 - val_loss: 0.1245 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0997 - val_loss: 0.1207 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0993 - val_loss: 0.1245 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0969 - val_loss: 0.1114 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.1088 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0866 - val_loss: 0.1042 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0824 - val_loss: 0.1001 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0774 - val_loss: 0.0988 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0753 - val_loss: 0.0951 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0725 - val_loss: 0.0943 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0720 - val_loss: 0.0905 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0683 - val_loss: 0.0885 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0675 - val_loss: 0.0864 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0651 - val_loss: 0.0846 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0634 - val_loss: 0.0833 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0618 - val_loss: 0.0822 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0612 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0607 - val_loss: 0.0807 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0597 - val_loss: 0.0797 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0598 - val_loss: 0.0795 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0605 - val_loss: 0.0783 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0602 - val_loss: 0.0772 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0601 - val_loss: 0.0765 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0595 - val_loss: 0.0760 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0586 - val_loss: 0.0758 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0590 - val_loss: 0.0757 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0586 - val_loss: 0.0756 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0582 - val_loss: 0.0755 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0583 - val_loss: 0.0754 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0585 - val_loss: 0.0753 - lr: 6.0967e-06

Epoch 38/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0571 - val_loss: 0.0753 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0753 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0582 - val_loss: 0.0753 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0574 - val_loss: 0.0753 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0572 - val_loss: 0.0753 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0573 - val_loss: 0.0753 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0572 - val_loss: 0.0753 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0584 - val_loss: 0.0753 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0753 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0586 - val_loss: 0.0753 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0577 - val_loss: 0.0753 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0578 - val_loss: 0.0753 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0576 - val_loss: 0.0753 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0575 - val_loss: 0.0753 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0570 - val_loss: 0.0753 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0581 - val_loss: 0.0753 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0579 - val_loss: 0.0753 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0585 - val_loss: 0.0753 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0580 - val_loss: 0.0753 - lr: 2.2897e-14
Average Validation Loss: 0.09000384658575059
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 215ms/step - loss: 0.2156 - val_loss: 0.2508 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 40ms/step - loss: 0.2175 - val_loss: 0.2549 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 37ms/step - loss: 0.2135 - val_loss: 0.2424 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 39ms/step - loss: 0.2035 - val_loss: 0.2293 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1956 - val_loss: 0.2209 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1859 - val_loss: 0.2186 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1754 - val_loss: 0.2210 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1695 - val_loss: 0.2131 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1553 - val_loss: 0.2132 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1486 - val_loss: 0.2145 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1443 - val_loss: 0.2013 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1349 - val_loss: 0.2032 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1311 - val_loss: 0.1945 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1262 - val_loss: 0.1875 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1252 - val_loss: 0.1986 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1228 - val_loss: 0.1806 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1193 - val_loss: 0.1997 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1198 - val_loss: 0.1792 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1179 - val_loss: 0.1828 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1139 - val_loss: 0.1864 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1153 - val_loss: 0.1796 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1133 - val_loss: 0.1782 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1119 - val_loss: 0.1815 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1137 - val_loss: 0.1787 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1122 - val_loss: 0.1756 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1120 - val_loss: 0.1775 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1115 - val_loss: 0.1789 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1126 - val_loss: 0.1793 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1110 - val_loss: 0.1778 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1106 - val_loss: 0.1760 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1111 - val_loss: 0.1757 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1111 - val_loss: 0.1760 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1100 - val_loss: 0.1764 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1087 - val_loss: 0.1766 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1114 - val_loss: 0.1769 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 59ms/step - loss: 0.1109 - val_loss: 0.1772 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1106 - val_loss: 0.1773 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1098 - val_loss: 0.1773 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1105 - val_loss: 0.1774 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1105 - val_loss: 0.1774 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1117 - val_loss: 0.1774 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1112 - val_loss: 0.1774 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1102 - val_loss: 0.1774 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1106 - val_loss: 0.1774 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1096 - val_loss: 0.1774 - lr: 3.3546e-07
Epoch 1/100
9/9 [==============================] - 5s 168ms/step - loss: 0.2624 - val_loss: 0.1912 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 39ms/step - loss: 0.2306 - val_loss: 0.1773 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 39ms/step - loss: 0.2159 - val_loss: 0.1870 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 38ms/step - loss: 0.2059 - val_loss: 0.1700 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1971 - val_loss: 0.1572 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1895 - val_loss: 0.1591 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1792 - val_loss: 0.1601 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1695 - val_loss: 0.1605 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1633 - val_loss: 0.1581 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1576 - val_loss: 0.1493 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1459 - val_loss: 0.1477 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1412 - val_loss: 0.1459 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1353 - val_loss: 0.1485 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1304 - val_loss: 0.1337 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1242 - val_loss: 0.1434 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1224 - val_loss: 0.1351 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1204 - val_loss: 0.1381 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1182 - val_loss: 0.1309 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1156 - val_loss: 0.1358 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1139 - val_loss: 0.1309 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1123 - val_loss: 0.1304 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1117 - val_loss: 0.1299 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1102 - val_loss: 0.1262 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1098 - val_loss: 0.1283 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1082 - val_loss: 0.1265 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1082 - val_loss: 0.1258 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1081 - val_loss: 0.1264 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1074 - val_loss: 0.1254 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1069 - val_loss: 0.1232 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1064 - val_loss: 0.1254 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1072 - val_loss: 0.1261 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1064 - val_loss: 0.1263 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1077 - val_loss: 0.1260 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1066 - val_loss: 0.1261 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 55ms/step - loss: 0.1074 - val_loss: 0.1256 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1070 - val_loss: 0.1253 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1059 - val_loss: 0.1249 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1063 - val_loss: 0.1247 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1072 - val_loss: 0.1245 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1063 - val_loss: 0.1245 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1066 - val_loss: 0.1245 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1067 - val_loss: 0.1245 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1066 - val_loss: 0.1245 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1062 - val_loss: 0.1245 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1074 - val_loss: 0.1245 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1068 - val_loss: 0.1245 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1071 - val_loss: 0.1245 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1068 - val_loss: 0.1245 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1049 - val_loss: 0.1245 - lr: 6.7729e-08
Epoch 1/100
13/13 [==============================] - 5s 94ms/step - loss: 0.2244 - val_loss: 0.2153 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 28ms/step - loss: 0.2084 - val_loss: 0.2088 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1875 - val_loss: 0.1864 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1819 - val_loss: 0.1709 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1691 - val_loss: 0.1645 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1578 - val_loss: 0.1454 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1513 - val_loss: 0.1320 - lr: 0.0010
Epoch 8/100

13/13 [==============================] - 0s 29ms/step - loss: 0.1468 - val_loss: 0.1275 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1379 - val_loss: 0.1314 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1285 - val_loss: 0.1221 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 35ms/step - loss: 0.1178 - val_loss: 0.1067 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1123 - val_loss: 0.1018 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1071 - val_loss: 0.0973 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1058 - val_loss: 0.0938 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1093 - val_loss: 0.0988 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1088 - val_loss: 0.1206 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1000 - val_loss: 0.1051 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0959 - val_loss: 0.0974 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0945 - val_loss: 0.0968 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0948 - val_loss: 0.1015 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0909 - val_loss: 0.0944 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0904 - val_loss: 0.0929 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0901 - val_loss: 0.0931 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0887 - val_loss: 0.0916 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0887 - val_loss: 0.0934 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0878 - val_loss: 0.0922 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0878 - val_loss: 0.0909 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0931 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0864 - val_loss: 0.0908 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0871 - val_loss: 0.0909 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0859 - val_loss: 0.0908 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0866 - val_loss: 0.0911 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0858 - val_loss: 0.0910 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0861 - val_loss: 0.0910 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0855 - val_loss: 0.0907 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0864 - val_loss: 0.0907 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0868 - val_loss: 0.0907 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0867 - val_loss: 0.0907 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0857 - val_loss: 0.0907 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0856 - val_loss: 0.0907 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0865 - val_loss: 0.0907 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0862 - val_loss: 0.0907 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0856 - val_loss: 0.0907 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0861 - val_loss: 0.0907 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0854 - val_loss: 0.0907 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0859 - val_loss: 0.0907 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 1s 46ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0863 - val_loss: 0.0907 - lr: 1.3710e-09
Epoch 58/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0864 - val_loss: 0.0907 - lr: 8.3153e-10
Epoch 59/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0866 - val_loss: 0.0907 - lr: 5.0435e-10
Epoch 1/100
17/17 [==============================] - 7s 111ms/step - loss: 0.2293 - val_loss: 0.2103 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 30ms/step - loss: 0.2015 - val_loss: 0.2015 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1850 - val_loss: 0.1899 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1734 - val_loss: 0.2008 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1702 - val_loss: 0.1652 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1543 - val_loss: 0.1468 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1377 - val_loss: 0.1527 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 29ms/step - loss: 0.1305 - val_loss: 0.1409 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1227 - val_loss: 0.1348 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1168 - val_loss: 0.1313 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1139 - val_loss: 0.1388 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1176 - val_loss: 0.1534 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1292 - val_loss: 0.1075 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 33ms/step - loss: 0.1104 - val_loss: 0.1024 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1047 - val_loss: 0.1045 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1041 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1025 - val_loss: 0.0928 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0984 - val_loss: 0.0889 - lr: 4.4933e-04
Epoch 19/100

17/17 [==============================] - 1s 32ms/step - loss: 0.0954 - val_loss: 0.0863 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0923 - val_loss: 0.0868 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0906 - val_loss: 0.0844 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0894 - val_loss: 0.0818 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0885 - val_loss: 0.0823 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0876 - val_loss: 0.0818 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0870 - val_loss: 0.0811 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0858 - val_loss: 0.0805 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0858 - val_loss: 0.0800 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0857 - val_loss: 0.0803 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0852 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0846 - val_loss: 0.0801 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0849 - val_loss: 0.0798 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0842 - val_loss: 0.0794 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0849 - val_loss: 0.0795 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0845 - val_loss: 0.0795 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0843 - val_loss: 0.0794 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0834 - val_loss: 0.0793 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0841 - val_loss: 0.0794 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0849 - val_loss: 0.0793 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0845 - val_loss: 0.0793 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0837 - val_loss: 0.0793 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0837 - val_loss: 0.0793 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0846 - val_loss: 0.0793 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0839 - val_loss: 0.0793 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0835 - val_loss: 0.0793 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0841 - val_loss: 0.0793 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 29ms/step - loss: 0.0847 - val_loss: 0.0793 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0849 - val_loss: 0.0793 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0845 - val_loss: 0.0793 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0848 - val_loss: 0.0793 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0840 - val_loss: 0.0793 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0843 - val_loss: 0.0793 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0852 - val_loss: 0.0793 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0838 - val_loss: 0.0793 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0844 - val_loss: 0.0793 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0842 - val_loss: 0.0793 - lr: 1.3816e-12
Epoch 1/100
22/22 [==============================] - 5s 59ms/step - loss: 0.2354 - val_loss: 0.2071 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.2011 - val_loss: 0.1923 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1839 - val_loss: 0.1753 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1696 - val_loss: 0.1620 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1589 - val_loss: 0.1553 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1534 - val_loss: 0.1512 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1449 - val_loss: 0.1465 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1350 - val_loss: 0.1337 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1221 - val_loss: 0.1228 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1141 - val_loss: 0.1165 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1040 - val_loss: 0.1104 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0999 - val_loss: 0.1032 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0949 - val_loss: 0.0987 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0880 - val_loss: 0.0905 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0858 - val_loss: 0.0884 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0822 - val_loss: 0.0861 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0811 - val_loss: 0.0858 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0783 - val_loss: 0.0837 - lr: 4.0657e-04

Epoch 20/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0776 - val_loss: 0.0839 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0776 - val_loss: 0.0870 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0765 - val_loss: 0.0858 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0762 - val_loss: 0.0852 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0768 - val_loss: 0.0848 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0771 - val_loss: 0.0811 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0761 - val_loss: 0.0807 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0738 - val_loss: 0.0812 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0736 - val_loss: 0.0804 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0732 - val_loss: 0.0804 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0730 - val_loss: 0.0804 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0728 - val_loss: 0.0803 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0726 - val_loss: 0.0803 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0721 - val_loss: 0.0803 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0719 - val_loss: 0.0802 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0724 - val_loss: 0.0802 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0722 - val_loss: 0.0802 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0713 - val_loss: 0.0802 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0714 - val_loss: 0.0802 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0716 - val_loss: 0.0802 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0718 - val_loss: 0.0802 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0717 - val_loss: 0.0802 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0714 - val_loss: 0.0802 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0720 - val_loss: 0.0802 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0721 - val_loss: 0.0802 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0715 - val_loss: 0.0802 - lr: 9.2853e-14
Average Validation Loss: 0.10979399234056472
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 64ms/step - loss: 0.1172 - val_loss: 0.1699 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1366 - val_loss: 0.1323 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 20ms/step - loss: 0.1126 - val_loss: 0.1398 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1144 - val_loss: 0.1306 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1011 - val_loss: 0.1399 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 23ms/step - loss: 0.1066 - val_loss: 0.1221 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0814 - val_loss: 0.1158 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0737 - val_loss: 0.1090 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0688 - val_loss: 0.1035 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0785 - val_loss: 0.0964 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0583 - val_loss: 0.0953 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0571 - val_loss: 0.1250 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0599 - val_loss: 0.1091 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0921 - lr: 6.7032e-04

Epoch 15/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0524 - val_loss: 0.0916 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0472 - val_loss: 0.0951 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0477 - val_loss: 0.1102 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0484 - val_loss: 0.1102 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0469 - val_loss: 0.1001 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0454 - val_loss: 0.0955 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0435 - val_loss: 0.0995 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0433 - val_loss: 0.0920 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0430 - val_loss: 0.1000 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0429 - val_loss: 0.0923 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0415 - val_loss: 0.0982 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0423 - val_loss: 0.0937 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0412 - val_loss: 0.0939 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0414 - val_loss: 0.0931 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0414 - val_loss: 0.0934 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0410 - val_loss: 0.0967 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0423 - val_loss: 0.0967 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0426 - val_loss: 0.0965 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0405 - val_loss: 0.0959 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0401 - val_loss: 0.0957 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.0953 - lr: 1.1109e-05
Epoch 1/100
34/34 [==============================] - 4s 34ms/step - loss: 0.1408 - val_loss: 0.1065 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1363 - val_loss: 0.0758 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1262 - val_loss: 0.0920 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1227 - val_loss: 0.0720 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1200 - val_loss: 0.0905 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1175 - val_loss: 0.0701 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1128 - val_loss: 0.0913 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1119 - val_loss: 0.0709 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1050 - val_loss: 0.0886 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1037 - val_loss: 0.0698 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0975 - val_loss: 0.0941 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0904 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0891 - val_loss: 0.0744 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0870 - val_loss: 0.0734 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0788 - val_loss: 0.0679 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0676 - val_loss: 0.0615 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0643 - val_loss: 0.0601 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0636 - val_loss: 0.0579 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0597 - val_loss: 0.0585 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0576 - val_loss: 0.0595 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0552 - val_loss: 0.0600 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0541 - val_loss: 0.0603 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0525 - val_loss: 0.0606 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0503 - val_loss: 0.0631 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0503 - val_loss: 0.0623 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0483 - val_loss: 0.0637 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0481 - val_loss: 0.0637 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0491 - val_loss: 0.0645 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0482 - val_loss: 0.0643 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0469 - val_loss: 0.0653 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0481 - val_loss: 0.0657 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0483 - val_loss: 0.0653 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0475 - val_loss: 0.0649 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0480 - val_loss: 0.0651 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0476 - val_loss: 0.0651 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0471 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0467 - val_loss: 0.0654 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0476 - val_loss: 0.0655 - lr: 3.3460e-06
Epoch 1/100
51/51 [==============================] - 5s 41ms/step - loss: 0.1381 - val_loss: 0.1209 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1225 - val_loss: 0.1160 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1150 - val_loss: 0.1100 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1114 - val_loss: 0.1058 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1077 - val_loss: 0.1017 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 22ms/step - loss: 0.1054 - val_loss: 0.0988 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 18ms/step - loss: 0.1032 - val_loss: 0.0986 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1022 - val_loss: 0.0959 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0991 - val_loss: 0.0959 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0986 - val_loss: 0.0942 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0916 - val_loss: 0.0875 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0896 - val_loss: 0.0883 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0827 - val_loss: 0.0796 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0765 - val_loss: 0.0745 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0731 - val_loss: 0.0656 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0647 - val_loss: 0.0618 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0614 - val_loss: 0.0623 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0572 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0529 - val_loss: 0.0566 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0520 - val_loss: 0.0557 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0504 - val_loss: 0.0540 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0549 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0513 - val_loss: 0.0532 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0515 - val_loss: 0.0523 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0544 - val_loss: 0.0509 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0520 - val_loss: 0.0520 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0511 - val_loss: 0.0543 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0490 - val_loss: 0.0547 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0486 - val_loss: 0.0553 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0487 - val_loss: 0.0561 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0562 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0463 - val_loss: 0.0556 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0463 - val_loss: 0.0556 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0454 - val_loss: 0.0557 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0453 - val_loss: 0.0555 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0453 - val_loss: 0.0554 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0453 - val_loss: 0.0553 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0456 - val_loss: 0.0553 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0450 - val_loss: 0.0553 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0453 - val_loss: 0.0553 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0554 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0452 - val_loss: 0.0553 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0446 - val_loss: 0.0554 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0452 - val_loss: 0.0554 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0554 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 5s 30ms/step - loss: 0.1296 - val_loss: 0.1332 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1199 - val_loss: 0.1222 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1120 - val_loss: 0.1143 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1074 - val_loss: 0.1022 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1003 - val_loss: 0.0961 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0966 - val_loss: 0.0915 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0887 - val_loss: 0.0901 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0824 - val_loss: 0.1012 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0787 - val_loss: 0.0903 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0712 - val_loss: 0.1203 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0701 - val_loss: 0.1121 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0657 - val_loss: 0.0904 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0624 - val_loss: 0.0867 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0608 - val_loss: 0.0731 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0598 - val_loss: 0.0688 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0590 - val_loss: 0.0658 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0657 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0538 - val_loss: 0.0634 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0620 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0629 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0501 - val_loss: 0.0618 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0495 - val_loss: 0.0631 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0483 - val_loss: 0.0646 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0481 - val_loss: 0.0622 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0489 - val_loss: 0.0617 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0601 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0494 - val_loss: 0.0557 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0478 - val_loss: 0.0541 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0529 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0461 - val_loss: 0.0525 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0462 - val_loss: 0.0516 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0453 - val_loss: 0.0513 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0452 - val_loss: 0.0511 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 1.1109e-05

Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0445 - val_loss: 0.0509 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0451 - val_loss: 0.0509 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0508 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0430 - val_loss: 0.0507 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0452 - val_loss: 0.0507 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0448 - val_loss: 0.0507 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0437 - val_loss: 0.0507 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0444 - val_loss: 0.0507 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0507 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0438 - val_loss: 0.0507 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0447 - val_loss: 0.0507 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0436 - val_loss: 0.0507 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0450 - val_loss: 0.0507 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0507 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0448 - val_loss: 0.0507 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0441 - val_loss: 0.0507 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0507 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0442 - val_loss: 0.0507 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0507 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0440 - val_loss: 0.0507 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0507 - lr: 6.9144e-16
Epoch 81/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0437 - val_loss: 0.0507 - lr: 3.1068e-16
Epoch 1/100
85/85 [==============================] - 5s 30ms/step - loss: 0.1315 - val_loss: 0.1098 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1141 - val_loss: 0.1032 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1045 - val_loss: 0.0986 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0995 - val_loss: 0.0967 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0907 - val_loss: 0.0926 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0835 - val_loss: 0.0898 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0764 - val_loss: 0.0892 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0756 - val_loss: 0.0897 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0726 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0667 - val_loss: 0.0811 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0605 - val_loss: 0.0780 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0590 - val_loss: 0.0757 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0567 - val_loss: 0.0730 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0545 - val_loss: 0.0725 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0532 - val_loss: 0.0702 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0510 - val_loss: 0.0695 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0494 - val_loss: 0.0688 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0481 - val_loss: 0.0672 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0479 - val_loss: 0.0662 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0467 - val_loss: 0.0657 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0442 - val_loss: 0.0637 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0437 - val_loss: 0.0628 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0616 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0417 - val_loss: 0.0609 - lr: 1.6530e-04

Epoch 25/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0404 - val_loss: 0.0598 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0402 - val_loss: 0.0597 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0388 - val_loss: 0.0591 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0394 - val_loss: 0.0588 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0376 - val_loss: 0.0581 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0381 - val_loss: 0.0586 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0381 - val_loss: 0.0582 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0384 - val_loss: 0.0572 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0376 - val_loss: 0.0565 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0376 - val_loss: 0.0560 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0372 - val_loss: 0.0558 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0371 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0557 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0556 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0359 - val_loss: 0.0555 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0373 - val_loss: 0.0555 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0362 - val_loss: 0.0555 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0361 - val_loss: 0.0555 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0370 - val_loss: 0.0555 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0359 - val_loss: 0.0555 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0366 - val_loss: 0.0555 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0363 - val_loss: 0.0555 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0367 - val_loss: 0.0555 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0361 - val_loss: 0.0555 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0365 - val_loss: 0.0555 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0364 - val_loss: 0.0555 - lr: 5.6464e-15
Epoch 78/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0369 - val_loss: 0.0555 - lr: 2.8039e-15
Epoch 79/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0368 - val_loss: 0.0555 - lr: 1.3924e-15
Average Validation Loss: 0.0613083653151989
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 121ms/step - loss: 0.1389 - val_loss: 0.1652 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1375 - val_loss: 0.1708 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1294 - val_loss: 0.1447 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1195 - val_loss: 0.1339 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1098 - val_loss: 0.1351 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1048 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1028 - val_loss: 0.1310 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0997 - val_loss: 0.1223 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0871 - val_loss: 0.1202 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0753 - val_loss: 0.1114 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0686 - val_loss: 0.1016 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0614 - val_loss: 0.1054 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0525 - val_loss: 0.1223 - lr: 7.4082e-04

Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0568 - val_loss: 0.1046 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0508 - val_loss: 0.1031 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0493 - val_loss: 0.1073 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0497 - val_loss: 0.1068 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0477 - val_loss: 0.1001 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0470 - val_loss: 0.1040 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0490 - val_loss: 0.1118 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0483 - val_loss: 0.0989 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0464 - val_loss: 0.1108 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0480 - val_loss: 0.0977 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0464 - val_loss: 0.1042 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0472 - val_loss: 0.0996 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0449 - val_loss: 0.1004 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0451 - val_loss: 0.1030 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0452 - val_loss: 0.1019 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0452 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0458 - val_loss: 0.1021 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0445 - val_loss: 0.1026 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.1025 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0445 - val_loss: 0.1019 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 1s 127ms/step - loss: 0.0462 - val_loss: 0.1019 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0446 - val_loss: 0.1019 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0449 - val_loss: 0.1021 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0437 - val_loss: 0.1023 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0450 - val_loss: 0.1024 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0453 - val_loss: 0.1023 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0459 - val_loss: 0.1022 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0462 - val_loss: 0.1022 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0443 - val_loss: 0.1022 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.1022 - lr: 7.4659e-07
Epoch 1/100
17/17 [==============================] - 3s 71ms/step - loss: 0.1655 - val_loss: 0.0875 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1336 - val_loss: 0.0909 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1248 - val_loss: 0.0846 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1205 - val_loss: 0.0826 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1163 - val_loss: 0.0834 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 20ms/step - loss: 0.1116 - val_loss: 0.0852 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1088 - val_loss: 0.0856 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1051 - val_loss: 0.0765 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1003 - val_loss: 0.0796 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0901 - val_loss: 0.0941 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0931 - val_loss: 0.0739 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0858 - val_loss: 0.0741 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0750 - val_loss: 0.0781 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0722 - val_loss: 0.0748 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0678 - val_loss: 0.0753 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0641 - val_loss: 0.0740 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0611 - val_loss: 0.0740 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0602 - val_loss: 0.0716 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0592 - val_loss: 0.0715 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0573 - val_loss: 0.0748 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0573 - val_loss: 0.0713 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0564 - val_loss: 0.0704 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0546 - val_loss: 0.0714 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0533 - val_loss: 0.0707 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0539 - val_loss: 0.0703 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0545 - val_loss: 0.0721 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0525 - val_loss: 0.0705 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0522 - val_loss: 0.0710 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0532 - val_loss: 0.0708 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0535 - val_loss: 0.0718 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0532 - val_loss: 0.0718 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0531 - val_loss: 0.0721 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0518 - val_loss: 0.0723 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0519 - val_loss: 0.0719 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0528 - val_loss: 0.0715 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0524 - val_loss: 0.0715 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0527 - val_loss: 0.0716 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0522 - val_loss: 0.0715 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0716 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0522 - val_loss: 0.0717 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0531 - val_loss: 0.0717 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0535 - val_loss: 0.0717 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0526 - val_loss: 0.0716 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0525 - val_loss: 0.0716 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0524 - val_loss: 0.0716 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 4s 49ms/step - loss: 0.1401 - val_loss: 0.1264 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1169 - val_loss: 0.1127 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1083 - val_loss: 0.1027 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1033 - val_loss: 0.0893 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1001 - val_loss: 0.0842 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0964 - val_loss: 0.0813 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0913 - val_loss: 0.0805 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0863 - val_loss: 0.0762 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0816 - val_loss: 0.0708 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0770 - val_loss: 0.0673 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0587 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0692 - val_loss: 0.0634 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0705 - val_loss: 0.0645 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0752 - val_loss: 0.0617 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0747 - val_loss: 0.0590 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0798 - val_loss: 0.0723 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0695 - val_loss: 0.0652 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0626 - val_loss: 0.0559 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0625 - val_loss: 0.0560 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0610 - val_loss: 0.0563 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0565 - val_loss: 0.0544 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0568 - val_loss: 0.0562 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0575 - val_loss: 0.0632 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0532 - val_loss: 0.0597 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0528 - val_loss: 0.0581 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0583 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0571 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0515 - val_loss: 0.0576 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0511 - val_loss: 0.0579 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0493 - val_loss: 0.0565 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0506 - val_loss: 0.0571 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0497 - val_loss: 0.0574 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0500 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0501 - val_loss: 0.0574 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0494 - val_loss: 0.0573 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0493 - val_loss: 0.0573 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0499 - val_loss: 0.0575 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0498 - val_loss: 0.0575 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0488 - val_loss: 0.0576 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0490 - val_loss: 0.0575 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0491 - val_loss: 0.0575 - lr: 1.6616e-06
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1409 - val_loss: 0.1127 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1124 - val_loss: 0.1186 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1063 - val_loss: 0.1131 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0963 - val_loss: 0.1014 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0899 - val_loss: 0.0786 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0794 - val_loss: 0.0775 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0722 - val_loss: 0.0738 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0653 - val_loss: 0.0907 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0657 - val_loss: 0.0882 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0715 - val_loss: 0.0685 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0631 - val_loss: 0.0713 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0641 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0573 - val_loss: 0.0634 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0564 - val_loss: 0.0688 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0547 - val_loss: 0.0639 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0533 - val_loss: 0.0606 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0531 - val_loss: 0.0687 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0518 - val_loss: 0.0691 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0526 - val_loss: 0.0759 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0528 - val_loss: 0.0702 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0525 - val_loss: 0.0872 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0627 - val_loss: 0.0851 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0680 - val_loss: 0.0609 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0589 - val_loss: 0.0515 - lr: 1.6530e-04
Epoch 25/100

34/34 [==============================] - 1s 22ms/step - loss: 0.0552 - val_loss: 0.0478 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0529 - val_loss: 0.0468 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0516 - val_loss: 0.0455 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0443 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0503 - val_loss: 0.0440 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0488 - val_loss: 0.0435 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0483 - val_loss: 0.0433 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0477 - val_loss: 0.0432 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0432 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0474 - val_loss: 0.0430 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0478 - val_loss: 0.0430 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0471 - val_loss: 0.0429 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0429 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0429 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0429 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0470 - val_loss: 0.0429 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0429 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0465 - val_loss: 0.0429 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0467 - val_loss: 0.0429 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0472 - val_loss: 0.0429 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0429 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0429 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0429 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0473 - val_loss: 0.0429 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0429 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0429 - lr: 3.0590e-10
Epoch 1/100
43/43 [==============================] - 5s 37ms/step - loss: 0.1261 - val_loss: 0.1122 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1052 - val_loss: 0.1049 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0965 - val_loss: 0.1008 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0873 - val_loss: 0.0964 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0830 - val_loss: 0.0940 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0797 - val_loss: 0.0917 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0758 - val_loss: 0.0891 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0720 - val_loss: 0.0863 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0711 - val_loss: 0.0848 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0670 - val_loss: 0.0880 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0664 - val_loss: 0.0888 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0690 - val_loss: 0.0836 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0624 - val_loss: 0.0862 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0609 - val_loss: 0.0792 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0569 - val_loss: 0.0745 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0532 - val_loss: 0.0728 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0506 - val_loss: 0.0705 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0501 - val_loss: 0.0692 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0682 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0662 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0653 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0647 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0443 - val_loss: 0.0640 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0433 - val_loss: 0.0633 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0436 - val_loss: 0.0627 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0429 - val_loss: 0.0620 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0428 - val_loss: 0.0616 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0434 - val_loss: 0.0610 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0424 - val_loss: 0.0602 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0425 - val_loss: 0.0596 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0416 - val_loss: 0.0593 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0409 - val_loss: 0.0590 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0589 - lr: 1.4996e-05

Epoch 35/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0409 - val_loss: 0.0588 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0405 - val_loss: 0.0587 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0410 - val_loss: 0.0587 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0403 - val_loss: 0.0586 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0407 - val_loss: 0.0586 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0402 - val_loss: 0.0585 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0400 - val_loss: 0.0585 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0398 - val_loss: 0.0585 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0402 - val_loss: 0.0585 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0407 - val_loss: 0.0585 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0401 - val_loss: 0.0585 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0400 - val_loss: 0.0585 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0407 - val_loss: 0.0585 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0404 - val_loss: 0.0585 - lr: 5.6464e-15
Epoch 78/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0406 - val_loss: 0.0585 - lr: 2.8039e-15
Epoch 79/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3924e-15
Epoch 80/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0410 - val_loss: 0.0585 - lr: 6.9144e-16
Epoch 81/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0405 - val_loss: 0.0585 - lr: 3.1068e-16
Epoch 82/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0408 - val_loss: 0.0585 - lr: 1.3960e-16
Epoch 83/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0403 - val_loss: 0.0585 - lr: 6.2726e-17
Average Validation Loss: 0.064755929261446
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 207ms/step - loss: 0.2585 - val_loss: 0.1727 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 73ms/step - loss: 0.1255 - val_loss: 0.1481 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1211 - val_loss: 0.1641 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 61ms/step - loss: 0.1293 - val_loss: 0.1663 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1317 - val_loss: 0.1571 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1226 - val_loss: 0.1418 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1155 - val_loss: 0.1295 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1115 - val_loss: 0.1244 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1058 - val_loss: 0.1235 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1029 - val_loss: 0.1248 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0989 - val_loss: 0.1238 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0918 - val_loss: 0.1165 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0843 - val_loss: 0.1074 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0735 - val_loss: 0.1056 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0668 - val_loss: 0.1024 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0602 - val_loss: 0.0994 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0577 - val_loss: 0.1055 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0591 - val_loss: 0.0993 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0571 - val_loss: 0.1050 - lr: 4.0657e-04
Epoch 20/100

5/5 [==============================] - 0s 39ms/step - loss: 0.0543 - val_loss: 0.1021 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0543 - val_loss: 0.1026 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0546 - val_loss: 0.1022 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0545 - val_loss: 0.1001 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0526 - val_loss: 0.1026 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0537 - val_loss: 0.1024 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0525 - val_loss: 0.1012 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0522 - val_loss: 0.1018 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0532 - val_loss: 0.1026 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0526 - val_loss: 0.1021 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0519 - val_loss: 0.1012 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0531 - val_loss: 0.1011 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0520 - val_loss: 0.1014 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0535 - val_loss: 0.1015 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0526 - val_loss: 0.1018 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0520 - val_loss: 0.1019 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0529 - val_loss: 0.1020 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0538 - val_loss: 0.1020 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0527 - val_loss: 0.1020 - lr: 4.5166e-06
Epoch 1/100
9/9 [==============================] - 4s 118ms/step - loss: 0.1392 - val_loss: 0.0910 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1260 - val_loss: 0.0967 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1190 - val_loss: 0.0900 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1112 - val_loss: 0.0759 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 34ms/step - loss: 0.1044 - val_loss: 0.0947 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1006 - val_loss: 0.0799 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0944 - val_loss: 0.0864 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0881 - val_loss: 0.0872 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0851 - val_loss: 0.0809 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0809 - val_loss: 0.0879 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0770 - val_loss: 0.0796 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0724 - val_loss: 0.0806 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0714 - val_loss: 0.0745 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0676 - val_loss: 0.0713 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0672 - val_loss: 0.0662 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0656 - val_loss: 0.0703 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0635 - val_loss: 0.0742 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0644 - val_loss: 0.0633 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0614 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0590 - val_loss: 0.0656 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0585 - val_loss: 0.0647 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0576 - val_loss: 0.0627 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0572 - val_loss: 0.0631 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0561 - val_loss: 0.0633 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0555 - val_loss: 0.0611 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0568 - val_loss: 0.0644 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0545 - val_loss: 0.0624 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0549 - val_loss: 0.0625 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0552 - val_loss: 0.0634 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0542 - val_loss: 0.0625 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0559 - val_loss: 0.0631 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0563 - val_loss: 0.0634 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0543 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0535 - val_loss: 0.0632 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0554 - val_loss: 0.0630 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0547 - val_loss: 0.0628 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0547 - val_loss: 0.0629 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0542 - val_loss: 0.0630 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0539 - val_loss: 0.0631 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0545 - val_loss: 0.0630 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0543 - val_loss: 0.0631 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0549 - val_loss: 0.0631 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0544 - val_loss: 0.0631 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0544 - val_loss: 0.0631 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0543 - val_loss: 0.0631 - lr: 3.3546e-07
Epoch 1/100
13/13 [==============================] - 4s 87ms/step - loss: 0.1474 - val_loss: 0.1286 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 26ms/step - loss: 0.1218 - val_loss: 0.1328 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1131 - val_loss: 0.1178 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 28ms/step - loss: 0.1059 - val_loss: 0.1071 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1038 - val_loss: 0.0962 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0987 - val_loss: 0.0923 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0952 - val_loss: 0.0842 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0928 - val_loss: 0.0784 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0882 - val_loss: 0.0742 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0871 - val_loss: 0.0728 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0816 - val_loss: 0.0709 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0785 - val_loss: 0.0691 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0733 - val_loss: 0.0664 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0700 - val_loss: 0.0637 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0675 - val_loss: 0.0624 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0673 - val_loss: 0.0609 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0701 - val_loss: 0.0624 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0659 - val_loss: 0.0632 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0613 - val_loss: 0.0596 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0608 - val_loss: 0.0577 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0593 - val_loss: 0.0572 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0580 - val_loss: 0.0560 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0573 - val_loss: 0.0571 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0570 - val_loss: 0.0563 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0562 - val_loss: 0.0553 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0560 - val_loss: 0.0560 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0557 - val_loss: 0.0556 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0554 - val_loss: 0.0548 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0550 - val_loss: 0.0551 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0552 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0546 - val_loss: 0.0551 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0548 - val_loss: 0.0552 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0542 - val_loss: 0.0548 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0545 - val_loss: 0.0547 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0549 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0541 - val_loss: 0.0548 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0551 - val_loss: 0.0549 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0543 - val_loss: 0.0550 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0550 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0536 - val_loss: 0.0550 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0540 - val_loss: 0.0549 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0549 - val_loss: 0.0549 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0538 - val_loss: 0.0549 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0539 - val_loss: 0.0549 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0545 - val_loss: 0.0549 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0534 - val_loss: 0.0549 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0541 - val_loss: 0.0549 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0543 - val_loss: 0.0549 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0544 - val_loss: 0.0549 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0546 - val_loss: 0.0549 - lr: 6.1442e-09
Epoch 1/100
17/17 [==============================] - 4s 76ms/step - loss: 0.1360 - val_loss: 0.1268 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 35ms/step - loss: 0.1200 - val_loss: 0.1163 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 34ms/step - loss: 0.1073 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1025 - val_loss: 0.1239 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1049 - val_loss: 0.1237 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1021 - val_loss: 0.0992 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0872 - val_loss: 0.1102 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0895 - val_loss: 0.1329 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1012 - val_loss: 0.0973 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0870 - val_loss: 0.0887 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0758 - val_loss: 0.1019 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0774 - val_loss: 0.1096 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0850 - val_loss: 0.0928 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0782 - val_loss: 0.0763 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0652 - val_loss: 0.0820 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0663 - val_loss: 0.0815 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0657 - val_loss: 0.0789 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0657 - val_loss: 0.0706 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0621 - val_loss: 0.0667 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0586 - val_loss: 0.0647 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0573 - val_loss: 0.0622 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0551 - val_loss: 0.0606 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0550 - val_loss: 0.0583 - lr: 2.0190e-04
Epoch 24/100

17/17 [==============================] - 0s 28ms/step - loss: 0.0529 - val_loss: 0.0575 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0572 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0519 - val_loss: 0.0562 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0518 - val_loss: 0.0555 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0521 - val_loss: 0.0551 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0507 - val_loss: 0.0549 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0517 - val_loss: 0.0545 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.0544 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0503 - val_loss: 0.0542 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0512 - val_loss: 0.0541 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0540 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0508 - val_loss: 0.0540 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0504 - val_loss: 0.0540 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0507 - val_loss: 0.0540 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0540 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0505 - val_loss: 0.0540 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0499 - val_loss: 0.0539 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0509 - val_loss: 0.0539 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0512 - val_loss: 0.0539 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0514 - val_loss: 0.0539 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0508 - val_loss: 0.0539 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0539 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0501 - val_loss: 0.0539 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0500 - val_loss: 0.0539 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0507 - val_loss: 0.0539 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0504 - val_loss: 0.0539 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0539 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0500 - val_loss: 0.0539 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0504 - val_loss: 0.0539 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0505 - val_loss: 0.0539 - lr: 2.2897e-14
Epoch 76/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0514 - val_loss: 0.0539 - lr: 1.1370e-14
Epoch 77/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0539 - lr: 5.6464e-15
Epoch 78/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0502 - val_loss: 0.0539 - lr: 2.8039e-15
Epoch 79/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0509 - val_loss: 0.0539 - lr: 1.3924e-15
Epoch 1/100
22/22 [==============================] - 4s 60ms/step - loss: 0.1322 - val_loss: 0.1169 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 24ms/step - loss: 0.1169 - val_loss: 0.1109 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1101 - val_loss: 0.1071 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1079 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1033 - val_loss: 0.1039 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0963 - val_loss: 0.0969 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0907 - val_loss: 0.0939 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0850 - val_loss: 0.0884 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0807 - val_loss: 0.0898 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0780 - val_loss: 0.0827 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0706 - val_loss: 0.0789 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0669 - val_loss: 0.0773 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0747 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0618 - val_loss: 0.0732 - lr: 6.7032e-04

Epoch 15/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0603 - val_loss: 0.0724 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0593 - val_loss: 0.0722 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0585 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0603 - val_loss: 0.0823 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0642 - val_loss: 0.0850 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0649 - val_loss: 0.0798 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0602 - val_loss: 0.0713 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0548 - val_loss: 0.0683 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0666 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0650 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0495 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0489 - val_loss: 0.0636 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0487 - val_loss: 0.0633 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0628 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0480 - val_loss: 0.0626 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0626 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0478 - val_loss: 0.0623 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0623 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0481 - val_loss: 0.0621 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0475 - val_loss: 0.0620 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0474 - val_loss: 0.0620 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0467 - val_loss: 0.0619 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0619 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0470 - val_loss: 0.0619 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0476 - val_loss: 0.0619 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0473 - val_loss: 0.0619 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0465 - val_loss: 0.0619 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0475 - val_loss: 0.0619 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0466 - val_loss: 0.0619 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0477 - val_loss: 0.0619 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0470 - val_loss: 0.0619 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0472 - val_loss: 0.0619 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0465 - val_loss: 0.0619 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0468 - val_loss: 0.0619 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0474 - val_loss: 0.0619 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0619 - lr: 2.2897e-14
Average Validation Loss: 0.06619365066289902
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 5s 68ms/step - loss: 0.1037 - val_loss: 0.1579 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1240 - val_loss: 0.1221 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1028 - val_loss: 0.1227 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0981 - val_loss: 0.1201 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0940 - val_loss: 0.1236 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0975 - val_loss: 0.1139 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0833 - val_loss: 0.1184 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0737 - val_loss: 0.1333 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0722 - val_loss: 0.1314 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0784 - val_loss: 0.1049 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0666 - val_loss: 0.0989 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0647 - val_loss: 0.0960 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0533 - val_loss: 0.1027 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0491 - val_loss: 0.0920 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0447 - val_loss: 0.0960 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0425 - val_loss: 0.0995 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0408 - val_loss: 0.0930 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.1025 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.1003 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0407 - val_loss: 0.0861 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0389 - val_loss: 0.0927 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0963 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0380 - val_loss: 0.0954 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0375 - val_loss: 0.0964 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0371 - val_loss: 0.0930 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0361 - val_loss: 0.0924 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0375 - val_loss: 0.0909 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0363 - val_loss: 0.0943 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0350 - val_loss: 0.0952 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0362 - val_loss: 0.0910 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0354 - val_loss: 0.0913 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0353 - val_loss: 0.0939 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0354 - val_loss: 0.0954 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0373 - val_loss: 0.0959 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0363 - val_loss: 0.0955 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0374 - val_loss: 0.0944 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0358 - val_loss: 0.0938 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0359 - val_loss: 0.0940 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0368 - val_loss: 0.0938 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0359 - val_loss: 0.0937 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 3s 34ms/step - loss: 0.1378 - val_loss: 0.0763 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1289 - val_loss: 0.0734 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1228 - val_loss: 0.0755 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1167 - val_loss: 0.0668 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1152 - val_loss: 0.0773 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1131 - val_loss: 0.0650 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1077 - val_loss: 0.0826 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1080 - val_loss: 0.0622 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1047 - val_loss: 0.0878 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1036 - val_loss: 0.0628 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0994 - val_loss: 0.0851 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0880 - val_loss: 0.0968 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0863 - val_loss: 0.0809 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0827 - val_loss: 0.0795 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0777 - val_loss: 0.0812 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0837 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0676 - val_loss: 0.0855 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0644 - val_loss: 0.0779 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0607 - val_loss: 0.0683 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0598 - val_loss: 0.0633 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0565 - val_loss: 0.0571 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0552 - val_loss: 0.0688 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0503 - val_loss: 0.0714 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0755 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0471 - val_loss: 0.0708 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0478 - val_loss: 0.0747 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0477 - val_loss: 0.0765 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0456 - val_loss: 0.0729 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0454 - val_loss: 0.0738 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0452 - val_loss: 0.0740 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0435 - val_loss: 0.0754 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0752 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0435 - val_loss: 0.0749 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0454 - val_loss: 0.0744 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0435 - val_loss: 0.0746 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0751 - lr: 8.2297e-06
Epoch 37/100

34/34 [==============================] - 1s 16ms/step - loss: 0.0448 - val_loss: 0.0753 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0443 - val_loss: 0.0754 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0445 - val_loss: 0.0752 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0446 - val_loss: 0.0751 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0429 - val_loss: 0.0751 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 5s 39ms/step - loss: 0.1186 - val_loss: 0.1113 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1103 - val_loss: 0.1039 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1062 - val_loss: 0.0947 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 17ms/step - loss: 0.1025 - val_loss: 0.0943 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0973 - val_loss: 0.0872 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0971 - val_loss: 0.0904 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0943 - val_loss: 0.0845 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0897 - val_loss: 0.0852 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0875 - val_loss: 0.0788 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0838 - val_loss: 0.0762 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0766 - val_loss: 0.0682 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0691 - val_loss: 0.0598 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0696 - val_loss: 0.0592 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0599 - val_loss: 0.0525 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0581 - val_loss: 0.0556 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0529 - val_loss: 0.0477 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0510 - val_loss: 0.0532 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0509 - val_loss: 0.0467 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0490 - val_loss: 0.0512 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0494 - val_loss: 0.0469 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0472 - val_loss: 0.0476 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0497 - val_loss: 0.0475 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0499 - val_loss: 0.0449 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0490 - val_loss: 0.0434 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0489 - val_loss: 0.0448 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0462 - val_loss: 0.0457 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0452 - val_loss: 0.0456 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0463 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0437 - val_loss: 0.0467 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0432 - val_loss: 0.0469 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0473 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0417 - val_loss: 0.0472 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0419 - val_loss: 0.0473 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0472 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0417 - val_loss: 0.0472 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0415 - val_loss: 0.0473 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0408 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0412 - val_loss: 0.0475 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0409 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0412 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0410 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0410 - val_loss: 0.0473 - lr: 5.0045e-07
Epoch 1/100
68/68 [==============================] - 5s 37ms/step - loss: 0.1181 - val_loss: 0.1171 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1095 - val_loss: 0.1095 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1043 - val_loss: 0.1026 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0991 - val_loss: 0.0968 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0951 - val_loss: 0.0951 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0863 - val_loss: 0.0906 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0810 - val_loss: 0.0910 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0743 - val_loss: 0.0909 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0896 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0695 - val_loss: 0.0852 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0659 - val_loss: 0.0776 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0757 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0604 - val_loss: 0.0716 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0598 - val_loss: 0.0673 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0553 - val_loss: 0.0654 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0538 - val_loss: 0.0654 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0516 - val_loss: 0.0642 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0512 - val_loss: 0.0635 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0699 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0506 - val_loss: 0.0651 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0488 - val_loss: 0.0658 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0479 - val_loss: 0.0642 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0477 - val_loss: 0.0623 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0457 - val_loss: 0.0625 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0467 - val_loss: 0.0625 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0483 - val_loss: 0.0589 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0466 - val_loss: 0.0562 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0473 - val_loss: 0.0525 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0465 - val_loss: 0.0512 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0450 - val_loss: 0.0496 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0487 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0429 - val_loss: 0.0484 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0440 - val_loss: 0.0481 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0429 - val_loss: 0.0479 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0428 - val_loss: 0.0476 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0426 - val_loss: 0.0476 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0475 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0475 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0425 - val_loss: 0.0474 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0416 - val_loss: 0.0474 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0425 - val_loss: 0.0474 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0413 - val_loss: 0.0474 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0413 - val_loss: 0.0474 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0412 - val_loss: 0.0474 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0416 - val_loss: 0.0474 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0415 - val_loss: 0.0474 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0424 - val_loss: 0.0474 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0414 - val_loss: 0.0474 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0418 - val_loss: 0.0474 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0417 - val_loss: 0.0474 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0421 - val_loss: 0.0474 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0422 - val_loss: 0.0474 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0420 - val_loss: 0.0474 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0419 - val_loss: 0.0474 - lr: 6.9144e-16
Epoch 1/100
85/85 [==============================] - 6s 31ms/step - loss: 0.1176 - val_loss: 0.1017 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 18ms/step - loss: 0.1039 - val_loss: 0.0966 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0944 - val_loss: 0.0930 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0874 - val_loss: 0.0892 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0834 - val_loss: 0.0878 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0780 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0727 - val_loss: 0.0831 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0717 - val_loss: 0.0837 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0725 - val_loss: 0.0770 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0624 - val_loss: 0.0717 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0578 - val_loss: 0.0690 - lr: 9.0484e-04

Epoch 12/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0541 - val_loss: 0.0653 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0525 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0539 - val_loss: 0.0639 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0488 - val_loss: 0.0627 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0463 - val_loss: 0.0615 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0471 - val_loss: 0.0619 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0465 - val_loss: 0.0591 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0436 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0421 - val_loss: 0.0585 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0420 - val_loss: 0.0576 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0399 - val_loss: 0.0568 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0381 - val_loss: 0.0556 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0371 - val_loss: 0.0555 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0362 - val_loss: 0.0548 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0358 - val_loss: 0.0543 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0350 - val_loss: 0.0544 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0354 - val_loss: 0.0546 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0357 - val_loss: 0.0541 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0355 - val_loss: 0.0540 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0359 - val_loss: 0.0536 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0357 - val_loss: 0.0533 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0353 - val_loss: 0.0531 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0356 - val_loss: 0.0529 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0350 - val_loss: 0.0528 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0344 - val_loss: 0.0527 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0344 - val_loss: 0.0527 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 3s 33ms/step - loss: 0.0348 - val_loss: 0.0526 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 3s 34ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 3s 39ms/step - loss: 0.0342 - val_loss: 0.0526 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 3s 36ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 3s 37ms/step - loss: 0.0338 - val_loss: 0.0526 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0346 - val_loss: 0.0526 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 3s 35ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0346 - val_loss: 0.0526 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0333 - val_loss: 0.0526 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0339 - val_loss: 0.0526 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0339 - val_loss: 0.0526 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0345 - val_loss: 0.0526 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0344 - val_loss: 0.0526 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0343 - val_loss: 0.0526 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0341 - val_loss: 0.0526 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0343 - val_loss: 0.0526 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0347 - val_loss: 0.0526 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0340 - val_loss: 0.0526 - lr: 5.6464e-15
Average Validation Loss: 0.057302170991897584
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.1117 - val_loss: 0.1679 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1274 - val_loss: 0.1533 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1156 - val_loss: 0.1210 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 25ms/step - loss: 0.0993 - val_loss: 0.1176 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0889 - val_loss: 0.1249 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0858 - val_loss: 0.1200 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0861 - val_loss: 0.1103 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0752 - val_loss: 0.1072 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0639 - val_loss: 0.1001 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0560 - val_loss: 0.0886 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0552 - val_loss: 0.0883 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0480 - val_loss: 0.1116 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0539 - val_loss: 0.1025 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0483 - val_loss: 0.0897 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0440 - val_loss: 0.1056 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0464 - val_loss: 0.0878 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0419 - val_loss: 0.0972 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0415 - val_loss: 0.0964 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0418 - val_loss: 0.0949 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0399 - val_loss: 0.0956 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0407 - val_loss: 0.0919 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0403 - val_loss: 0.0963 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0393 - val_loss: 0.0910 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0375 - val_loss: 0.0949 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0378 - val_loss: 0.0951 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0394 - val_loss: 0.0933 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0387 - val_loss: 0.0927 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0388 - val_loss: 0.0909 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0385 - val_loss: 0.0934 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0389 - val_loss: 0.0948 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0392 - val_loss: 0.0927 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0389 - val_loss: 0.0917 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0393 - val_loss: 0.0922 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0385 - val_loss: 0.0925 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0387 - val_loss: 0.0921 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0379 - val_loss: 0.0919 - lr: 8.2297e-06
Epoch 1/100
17/17 [==============================] - 4s 65ms/step - loss: 0.1403 - val_loss: 0.0739 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1216 - val_loss: 0.0819 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1104 - val_loss: 0.0735 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1043 - val_loss: 0.0735 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1030 - val_loss: 0.0714 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0976 - val_loss: 0.0718 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0891 - val_loss: 0.0795 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0918 - val_loss: 0.0753 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0885 - val_loss: 0.0753 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0793 - val_loss: 0.0824 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0771 - val_loss: 0.0762 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0738 - val_loss: 0.0722 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0680 - val_loss: 0.0658 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0635 - val_loss: 0.0645 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0612 - val_loss: 0.0649 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0577 - val_loss: 0.0626 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0556 - val_loss: 0.0603 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0540 - val_loss: 0.0602 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0520 - val_loss: 0.0627 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0511 - val_loss: 0.0672 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0492 - val_loss: 0.0676 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0504 - val_loss: 0.0625 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0496 - val_loss: 0.0645 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0475 - val_loss: 0.0644 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0475 - val_loss: 0.0658 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0454 - val_loss: 0.0656 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0459 - val_loss: 0.0680 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0460 - val_loss: 0.0647 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0461 - val_loss: 0.0662 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0458 - val_loss: 0.0655 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0465 - val_loss: 0.0643 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0459 - val_loss: 0.0653 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0462 - val_loss: 0.0655 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0655 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0456 - val_loss: 0.0658 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0453 - val_loss: 0.0658 - lr: 8.2297e-06

Epoch 37/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0460 - val_loss: 0.0660 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0455 - val_loss: 0.0660 - lr: 4.5166e-06
Epoch 1/100
26/26 [==============================] - 6s 49ms/step - loss: 0.1290 - val_loss: 0.1201 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 0s 19ms/step - loss: 0.1117 - val_loss: 0.1126 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 21ms/step - loss: 0.1018 - val_loss: 0.1033 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0993 - val_loss: 0.0946 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0940 - val_loss: 0.0870 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0893 - val_loss: 0.0849 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0849 - val_loss: 0.0830 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0795 - val_loss: 0.0748 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0761 - val_loss: 0.0782 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0732 - val_loss: 0.0649 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0687 - val_loss: 0.0739 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0697 - val_loss: 0.0710 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0667 - val_loss: 0.0729 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0720 - val_loss: 0.0623 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0635 - val_loss: 0.0619 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0647 - val_loss: 0.0586 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0601 - val_loss: 0.0572 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0570 - val_loss: 0.0560 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0529 - val_loss: 0.0550 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0524 - val_loss: 0.0538 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0519 - val_loss: 0.0524 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0526 - val_loss: 0.0519 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0532 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0485 - val_loss: 0.0518 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0475 - val_loss: 0.0515 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0471 - val_loss: 0.0507 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0509 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0452 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0458 - val_loss: 0.0506 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0449 - val_loss: 0.0505 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0502 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0502 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0444 - val_loss: 0.0501 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0438 - val_loss: 0.0499 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0499 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0449 - val_loss: 0.0499 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0499 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0450 - val_loss: 0.0498 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0440 - val_loss: 0.0498 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0447 - val_loss: 0.0498 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0455 - val_loss: 0.0498 - lr: 1.1138e-06
Epoch 43/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0442 - val_loss: 0.0498 - lr: 7.4659e-07
Epoch 44/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0435 - val_loss: 0.0498 - lr: 5.0045e-07
Epoch 45/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0498 - lr: 3.3546e-07
Epoch 46/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0498 - lr: 2.2487e-07
Epoch 47/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 1.5073e-07
Epoch 48/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 1.0104e-07
Epoch 49/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0434 - val_loss: 0.0498 - lr: 6.7729e-08
Epoch 50/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 4.5400e-08
Epoch 51/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0442 - val_loss: 0.0498 - lr: 2.7536e-08
Epoch 52/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0438 - val_loss: 0.0498 - lr: 1.6702e-08
Epoch 53/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0434 - val_loss: 0.0498 - lr: 1.0130e-08
Epoch 54/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0451 - val_loss: 0.0498 - lr: 6.1442e-09
Epoch 55/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0439 - val_loss: 0.0498 - lr: 3.7267e-09
Epoch 56/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0436 - val_loss: 0.0498 - lr: 2.2603e-09
Epoch 57/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 1.3710e-09
Epoch 58/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0446 - val_loss: 0.0498 - lr: 8.3153e-10
Epoch 59/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 5.0435e-10
Epoch 60/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0498 - lr: 3.0590e-10
Epoch 61/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0449 - val_loss: 0.0498 - lr: 1.6788e-10
Epoch 62/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 9.2136e-11
Epoch 63/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0448 - val_loss: 0.0498 - lr: 5.0565e-11
Epoch 64/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0445 - val_loss: 0.0498 - lr: 2.7751e-11
Epoch 1/100
34/34 [==============================] - 4s 48ms/step - loss: 0.1218 - val_loss: 0.1005 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0971 - val_loss: 0.1130 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0919 - val_loss: 0.0861 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0829 - val_loss: 0.0809 - lr: 0.0010
Epoch 5/100

34/34 [==============================] - 1s 22ms/step - loss: 0.0788 - val_loss: 0.0872 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0741 - val_loss: 0.0761 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0664 - val_loss: 0.0721 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0639 - val_loss: 0.0702 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0607 - val_loss: 0.0687 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0697 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0589 - val_loss: 0.0689 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0559 - val_loss: 0.0678 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0548 - val_loss: 0.0662 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0531 - val_loss: 0.0759 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0530 - val_loss: 0.0674 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0524 - val_loss: 0.0806 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0538 - val_loss: 0.0801 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0525 - val_loss: 0.0823 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0539 - val_loss: 0.0886 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0629 - val_loss: 0.0996 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0711 - val_loss: 0.0701 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0594 - val_loss: 0.0629 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0573 - val_loss: 0.0600 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0551 - val_loss: 0.0562 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0523 - val_loss: 0.0544 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0508 - val_loss: 0.0533 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0498 - val_loss: 0.0530 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0490 - val_loss: 0.0524 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0477 - val_loss: 0.0520 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0478 - val_loss: 0.0517 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0515 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0464 - val_loss: 0.0514 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0463 - val_loss: 0.0512 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0464 - val_loss: 0.0512 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0511 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0511 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0510 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0450 - val_loss: 0.0510 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0463 - val_loss: 0.0510 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0510 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0510 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0464 - val_loss: 0.0510 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0461 - val_loss: 0.0510 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0453 - val_loss: 0.0510 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0458 - val_loss: 0.0510 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0455 - val_loss: 0.0510 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0462 - val_loss: 0.0510 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0453 - val_loss: 0.0510 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0460 - val_loss: 0.0510 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0462 - val_loss: 0.0510 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0457 - val_loss: 0.0510 - lr: 4.6110e-14

Epoch 75/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0456 - val_loss: 0.0510 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0459 - val_loss: 0.0510 - lr: 1.1370e-14
Epoch 1/100
43/43 [==============================] - 5s 39ms/step - loss: 0.1211 - val_loss: 0.1084 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 28ms/step - loss: 0.1021 - val_loss: 0.1047 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0896 - val_loss: 0.0992 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0843 - val_loss: 0.0946 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0796 - val_loss: 0.0929 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0741 - val_loss: 0.0899 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0668 - val_loss: 0.0861 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0596 - val_loss: 0.0841 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0867 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0660 - val_loss: 0.0841 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0589 - val_loss: 0.0809 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0598 - val_loss: 0.0851 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0633 - val_loss: 0.0789 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0572 - val_loss: 0.0779 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0533 - val_loss: 0.0766 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0488 - val_loss: 0.0761 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0479 - val_loss: 0.0759 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0478 - val_loss: 0.0731 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0448 - val_loss: 0.0713 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0438 - val_loss: 0.0699 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0431 - val_loss: 0.0689 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0414 - val_loss: 0.0691 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0397 - val_loss: 0.0684 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0403 - val_loss: 0.0682 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0677 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0410 - val_loss: 0.0674 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0423 - val_loss: 0.0674 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0423 - val_loss: 0.0663 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0422 - val_loss: 0.0650 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0408 - val_loss: 0.0644 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0399 - val_loss: 0.0640 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0392 - val_loss: 0.0638 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0389 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0381 - val_loss: 0.0636 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0387 - val_loss: 0.0635 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0386 - val_loss: 0.0634 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0381 - val_loss: 0.0634 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0387 - val_loss: 0.0634 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0386 - val_loss: 0.0634 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0384 - val_loss: 0.0633 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0373 - val_loss: 0.0633 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0376 - val_loss: 0.0633 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0381 - val_loss: 0.0633 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0385 - val_loss: 0.0633 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0376 - val_loss: 0.0633 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0374 - val_loss: 0.0633 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0377 - val_loss: 0.0633 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0378 - val_loss: 0.0633 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0377 - val_loss: 0.0633 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 2.5175e-12

Epoch 69/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0380 - val_loss: 0.0633 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0379 - val_loss: 0.0633 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0384 - val_loss: 0.0633 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0383 - val_loss: 0.0633 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0382 - val_loss: 0.0633 - lr: 1.1370e-14
Average Validation Loss: 0.06242504194378853
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.2, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 4s 211ms/step - loss: 0.1598 - val_loss: 0.1249 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0981 - val_loss: 0.1422 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1106 - val_loss: 0.1536 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1144 - val_loss: 0.1479 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1095 - val_loss: 0.1350 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1052 - val_loss: 0.1245 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0993 - val_loss: 0.1195 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0955 - val_loss: 0.1187 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0904 - val_loss: 0.1203 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0881 - val_loss: 0.1213 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0822 - val_loss: 0.1202 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0786 - val_loss: 0.1115 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0707 - val_loss: 0.1037 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0606 - val_loss: 0.1030 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0574 - val_loss: 0.1001 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0525 - val_loss: 0.0970 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0509 - val_loss: 0.0963 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0472 - val_loss: 0.0967 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0451 - val_loss: 0.0943 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0451 - val_loss: 0.0993 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0440 - val_loss: 0.0954 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0433 - val_loss: 0.0938 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0433 - val_loss: 0.0969 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0429 - val_loss: 0.0953 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0428 - val_loss: 0.0923 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0428 - val_loss: 0.0950 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0431 - val_loss: 0.0964 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0429 - val_loss: 0.0963 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 49ms/step - loss: 0.0428 - val_loss: 0.0953 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 57ms/step - loss: 0.0431 - val_loss: 0.0942 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 67ms/step - loss: 0.0430 - val_loss: 0.0936 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0421 - val_loss: 0.0938 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 63ms/step - loss: 0.0433 - val_loss: 0.0939 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 53ms/step - loss: 0.0421 - val_loss: 0.0938 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 66ms/step - loss: 0.0439 - val_loss: 0.0939 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 57ms/step - loss: 0.0417 - val_loss: 0.0941 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 92ms/step - loss: 0.0425 - val_loss: 0.0942 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 61ms/step - loss: 0.0419 - val_loss: 0.0942 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 69ms/step - loss: 0.0411 - val_loss: 0.0942 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 55ms/step - loss: 0.0406 - val_loss: 0.0941 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0427 - val_loss: 0.0941 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0411 - val_loss: 0.0941 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 52ms/step - loss: 0.0411 - val_loss: 0.0942 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0417 - val_loss: 0.0942 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 51ms/step - loss: 0.0431 - val_loss: 0.0942 - lr: 3.3546e-07
Epoch 1/100
9/9 [==============================] - 5s 130ms/step - loss: 0.1463 - val_loss: 0.0795 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1222 - val_loss: 0.0751 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1121 - val_loss: 0.0766 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1082 - val_loss: 0.0735 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1014 - val_loss: 0.0674 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0953 - val_loss: 0.0766 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0893 - val_loss: 0.0754 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0847 - val_loss: 0.0789 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0785 - val_loss: 0.0827 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0755 - val_loss: 0.0754 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0702 - val_loss: 0.0640 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0677 - val_loss: 0.0644 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0647 - val_loss: 0.0730 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0612 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0607 - val_loss: 0.0727 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0596 - val_loss: 0.0682 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0582 - val_loss: 0.0663 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0577 - val_loss: 0.0749 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0568 - val_loss: 0.0703 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0551 - val_loss: 0.0639 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0550 - val_loss: 0.0665 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0534 - val_loss: 0.0662 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0522 - val_loss: 0.0630 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0518 - val_loss: 0.0641 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0516 - val_loss: 0.0643 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0522 - val_loss: 0.0644 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0513 - val_loss: 0.0640 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0505 - val_loss: 0.0652 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0512 - val_loss: 0.0647 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0505 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0509 - val_loss: 0.0639 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0516 - val_loss: 0.0636 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 35ms/step - loss: 0.0499 - val_loss: 0.0637 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0502 - val_loss: 0.0638 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0513 - val_loss: 0.0637 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0509 - val_loss: 0.0637 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0518 - val_loss: 0.0640 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0501 - val_loss: 0.0641 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0503 - val_loss: 0.0641 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0505 - val_loss: 0.0641 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0497 - val_loss: 0.0641 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0508 - val_loss: 0.0641 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0504 - val_loss: 0.0641 - lr: 5.0045e-07
Epoch 1/100
13/13 [==============================] - 4s 99ms/step - loss: 0.1260 - val_loss: 0.1102 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1048 - val_loss: 0.1155 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0920 - val_loss: 0.0991 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0904 - val_loss: 0.0930 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0834 - val_loss: 0.0831 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0795 - val_loss: 0.0749 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0747 - val_loss: 0.0695 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0703 - val_loss: 0.0667 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0651 - val_loss: 0.0616 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0626 - val_loss: 0.0624 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0649 - val_loss: 0.0589 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0657 - val_loss: 0.0629 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0587 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0518 - val_loss: 0.0530 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0494 - val_loss: 0.0492 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0520 - val_loss: 0.0481 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0537 - val_loss: 0.0498 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0525 - val_loss: 0.0572 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0481 - val_loss: 0.0546 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0465 - val_loss: 0.0535 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0441 - val_loss: 0.0484 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0445 - val_loss: 0.0478 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0440 - val_loss: 0.0506 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0439 - val_loss: 0.0506 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0437 - val_loss: 0.0500 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0432 - val_loss: 0.0489 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0436 - val_loss: 0.0509 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0430 - val_loss: 0.0503 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0431 - val_loss: 0.0496 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0427 - val_loss: 0.0495 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0424 - val_loss: 0.0501 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0422 - val_loss: 0.0496 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0420 - val_loss: 0.0494 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0422 - val_loss: 0.0496 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0424 - val_loss: 0.0500 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0414 - val_loss: 0.0502 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0425 - val_loss: 0.0502 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0431 - val_loss: 0.0501 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0417 - val_loss: 0.0501 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0420 - val_loss: 0.0501 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0427 - val_loss: 0.0501 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0428 - val_loss: 0.0501 - lr: 1.1138e-06
Epoch 1/100

17/17 [==============================] - 5s 151ms/step - loss: 0.1129 - val_loss: 0.0976 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 50ms/step - loss: 0.0963 - val_loss: 0.1130 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 49ms/step - loss: 0.0952 - val_loss: 0.1086 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0903 - val_loss: 0.1074 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0889 - val_loss: 0.1076 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0869 - val_loss: 0.0883 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0755 - val_loss: 0.0918 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0703 - val_loss: 0.0916 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0675 - val_loss: 0.0851 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0696 - val_loss: 0.1049 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0772 - val_loss: 0.1168 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0852 - val_loss: 0.0678 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0611 - val_loss: 0.0768 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0630 - val_loss: 0.0820 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0683 - val_loss: 0.0753 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0681 - val_loss: 0.0560 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0546 - val_loss: 0.0577 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0539 - val_loss: 0.0535 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0530 - val_loss: 0.0536 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0522 - val_loss: 0.0513 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0520 - val_loss: 0.0457 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0493 - val_loss: 0.0436 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0481 - val_loss: 0.0437 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0462 - val_loss: 0.0433 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0460 - val_loss: 0.0433 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0461 - val_loss: 0.0422 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0455 - val_loss: 0.0420 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0460 - val_loss: 0.0415 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0453 - val_loss: 0.0415 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0452 - val_loss: 0.0413 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0449 - val_loss: 0.0413 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0449 - val_loss: 0.0410 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0439 - val_loss: 0.0410 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0442 - val_loss: 0.0409 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0438 - val_loss: 0.0409 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0442 - val_loss: 0.0409 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0449 - val_loss: 0.0409 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0447 - val_loss: 0.0409 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0449 - val_loss: 0.0409 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0443 - val_loss: 0.0409 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0447 - val_loss: 0.0409 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0446 - val_loss: 0.0409 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0445 - val_loss: 0.0409 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0443 - val_loss: 0.0409 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0437 - val_loss: 0.0409 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0441 - val_loss: 0.0409 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0438 - val_loss: 0.0409 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0444 - val_loss: 0.0409 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0448 - val_loss: 0.0409 - lr: 5.0435e-10
Epoch 1/100
22/22 [==============================] - 5s 60ms/step - loss: 0.1263 - val_loss: 0.1076 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1090 - val_loss: 0.1062 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0988 - val_loss: 0.1029 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0974 - val_loss: 0.1017 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0961 - val_loss: 0.1021 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0938 - val_loss: 0.1017 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0914 - val_loss: 0.0992 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0862 - val_loss: 0.0954 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0839 - val_loss: 0.0947 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0841 - val_loss: 0.0966 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0840 - val_loss: 0.0994 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0814 - val_loss: 0.0973 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0777 - val_loss: 0.0943 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0731 - val_loss: 0.0924 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0696 - val_loss: 0.0896 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0671 - val_loss: 0.0887 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0645 - val_loss: 0.0877 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0626 - val_loss: 0.0871 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0618 - val_loss: 0.0859 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0612 - val_loss: 0.0840 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0579 - val_loss: 0.0790 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0540 - val_loss: 0.0755 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0520 - val_loss: 0.0752 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0723 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0494 - val_loss: 0.0711 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0493 - val_loss: 0.0705 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0491 - val_loss: 0.0698 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0481 - val_loss: 0.0691 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0687 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0477 - val_loss: 0.0683 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0478 - val_loss: 0.0682 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0681 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0472 - val_loss: 0.0680 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0678 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0466 - val_loss: 0.0678 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0678 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0471 - val_loss: 0.0677 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0467 - val_loss: 0.0676 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0469 - val_loss: 0.0676 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0473 - val_loss: 0.0676 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0470 - val_loss: 0.0676 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0471 - val_loss: 0.0676 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0463 - val_loss: 0.0675 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0463 - val_loss: 0.0675 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0474 - val_loss: 0.0675 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0469 - val_loss: 0.0675 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0475 - val_loss: 0.0675 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 57ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 50ms/step - loss: 0.0460 - val_loss: 0.0675 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 49ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 54ms/step - loss: 0.0471 - val_loss: 0.0675 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0467 - val_loss: 0.0675 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0464 - val_loss: 0.0675 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0459 - val_loss: 0.0675 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0469 - val_loss: 0.0675 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0675 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0462 - val_loss: 0.0675 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0464 - val_loss: 0.0675 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0470 - val_loss: 0.0675 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0472 - val_loss: 0.0675 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0476 - val_loss: 0.0675 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0475 - val_loss: 0.0675 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 24ms/step - loss: 0.0465 - val_loss: 0.0675 - lr: 2.2897e-14
Average Validation Loss: 0.06229816898703575
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 65ms/step - loss: 0.2367 - val_loss: 0.2575 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 16ms/step - loss: 0.2288 - val_loss: 0.2289 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 18ms/step - loss: 0.2075 - val_loss: 0.2204 - lr: 0.0010
Epoch 4/100

18/18 [==============================] - 0s 17ms/step - loss: 0.2005 - val_loss: 0.2088 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1858 - val_loss: 0.2045 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1777 - val_loss: 0.1938 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1643 - val_loss: 0.1953 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 17ms/step - loss: 0.1641 - val_loss: 0.1800 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 18ms/step - loss: 0.1459 - val_loss: 0.1823 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 16ms/step - loss: 0.1229 - val_loss: 0.2187 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1431 - val_loss: 0.1828 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1295 - val_loss: 0.1558 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1218 - val_loss: 0.1523 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1115 - val_loss: 0.1532 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1032 - val_loss: 0.1498 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0967 - val_loss: 0.1430 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0949 - val_loss: 0.1388 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0916 - val_loss: 0.1439 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 0s 16ms/step - loss: 0.0900 - val_loss: 0.1445 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0900 - val_loss: 0.1330 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0927 - val_loss: 0.1390 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0894 - val_loss: 0.1472 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0880 - val_loss: 0.1351 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0866 - val_loss: 0.1435 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0862 - val_loss: 0.1366 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0830 - val_loss: 0.1407 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0860 - val_loss: 0.1404 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0862 - val_loss: 0.1373 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0849 - val_loss: 0.1356 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0835 - val_loss: 0.1400 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0839 - val_loss: 0.1355 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0849 - val_loss: 0.1367 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0853 - val_loss: 0.1379 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 17ms/step - loss: 0.0824 - val_loss: 0.1386 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0858 - val_loss: 0.1377 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0836 - val_loss: 0.1380 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0832 - val_loss: 0.1371 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0823 - val_loss: 0.1365 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 18ms/step - loss: 0.0844 - val_loss: 0.1367 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0829 - val_loss: 0.1368 - lr: 2.4788e-06
Epoch 1/100
34/34 [==============================] - 6s 57ms/step - loss: 0.2431 - val_loss: 0.2020 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 21ms/step - loss: 0.2230 - val_loss: 0.1598 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1975 - val_loss: 0.1512 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1833 - val_loss: 0.1309 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1687 - val_loss: 0.1272 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1619 - val_loss: 0.1084 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1539 - val_loss: 0.1224 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1459 - val_loss: 0.1006 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1411 - val_loss: 0.1240 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1307 - val_loss: 0.0956 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1297 - val_loss: 0.1022 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1231 - val_loss: 0.0889 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1192 - val_loss: 0.1093 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.1123 - val_loss: 0.0880 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 18ms/step - loss: 0.1077 - val_loss: 0.0986 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1010 - val_loss: 0.0961 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0999 - val_loss: 0.0843 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0956 - val_loss: 0.0838 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0893 - val_loss: 0.0815 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0846 - val_loss: 0.0801 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0820 - val_loss: 0.0753 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0827 - val_loss: 0.0718 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0793 - val_loss: 0.0729 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0748 - val_loss: 0.0729 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0731 - val_loss: 0.0730 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0722 - val_loss: 0.0737 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0707 - val_loss: 0.0750 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0693 - val_loss: 0.0750 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0696 - val_loss: 0.0760 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0687 - val_loss: 0.0755 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0686 - val_loss: 0.0759 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0694 - val_loss: 0.0750 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0680 - val_loss: 0.0755 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0674 - val_loss: 0.0759 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0679 - val_loss: 0.0764 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0680 - val_loss: 0.0763 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0681 - val_loss: 0.0762 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0673 - val_loss: 0.0764 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0675 - val_loss: 0.0762 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0686 - val_loss: 0.0762 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0670 - val_loss: 0.0762 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0672 - val_loss: 0.0762 - lr: 1.1138e-06
Epoch 1/100
51/51 [==============================] - 11s 35ms/step - loss: 0.2357 - val_loss: 0.2039 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 15ms/step - loss: 0.1929 - val_loss: 0.1693 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1741 - val_loss: 0.1511 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1531 - val_loss: 0.1367 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 25ms/step - loss: 0.1440 - val_loss: 0.1277 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1347 - val_loss: 0.1199 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1303 - val_loss: 0.1173 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1230 - val_loss: 0.1120 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1199 - val_loss: 0.1125 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1152 - val_loss: 0.1037 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 26ms/step - loss: 0.1119 - val_loss: 0.1075 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 24ms/step - loss: 0.1058 - val_loss: 0.0991 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0991 - val_loss: 0.0891 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0982 - val_loss: 0.0909 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0882 - val_loss: 0.0767 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0871 - val_loss: 0.0843 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 2s 31ms/step - loss: 0.0819 - val_loss: 0.0736 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0782 - val_loss: 0.0742 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0756 - val_loss: 0.0693 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0710 - val_loss: 0.0690 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0697 - val_loss: 0.0657 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0681 - val_loss: 0.0665 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0664 - val_loss: 0.0640 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0650 - val_loss: 0.0659 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0657 - val_loss: 0.0645 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0636 - val_loss: 0.0632 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0654 - val_loss: 0.0613 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0643 - val_loss: 0.0600 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0614 - val_loss: 0.0599 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0625 - val_loss: 0.0597 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 2s 31ms/step - loss: 0.0618 - val_loss: 0.0596 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0606 - val_loss: 0.0599 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 2s 37ms/step - loss: 0.0595 - val_loss: 0.0599 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0606 - val_loss: 0.0602 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 3s 51ms/step - loss: 0.0597 - val_loss: 0.0601 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0602 - val_loss: 0.0601 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0591 - val_loss: 0.0600 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0588 - val_loss: 0.0599 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 2s 41ms/step - loss: 0.0598 - val_loss: 0.0599 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 2s 44ms/step - loss: 0.0595 - val_loss: 0.0599 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 2s 42ms/step - loss: 0.0592 - val_loss: 0.0599 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 3s 50ms/step - loss: 0.0585 - val_loss: 0.0600 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 2s 37ms/step - loss: 0.0590 - val_loss: 0.0600 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0599 - val_loss: 0.0599 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 2s 34ms/step - loss: 0.0592 - val_loss: 0.0600 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 2s 38ms/step - loss: 0.0595 - val_loss: 0.0600 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0596 - val_loss: 0.0600 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0605 - val_loss: 0.0600 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0602 - val_loss: 0.0600 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0597 - val_loss: 0.0600 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 2s 40ms/step - loss: 0.0599 - val_loss: 0.0600 - lr: 2.7536e-08
Epoch 1/100
68/68 [==============================] - 11s 47ms/step - loss: 0.2219 - val_loss: 0.2051 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 2s 22ms/step - loss: 0.1823 - val_loss: 0.1738 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1573 - val_loss: 0.1556 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 2s 25ms/step - loss: 0.1416 - val_loss: 0.1359 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 2s 23ms/step - loss: 0.1310 - val_loss: 0.1281 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 2s 26ms/step - loss: 0.1206 - val_loss: 0.1165 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 36ms/step - loss: 0.1148 - val_loss: 0.1144 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 31ms/step - loss: 0.1082 - val_loss: 0.1024 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 2s 29ms/step - loss: 0.1017 - val_loss: 0.0984 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0947 - val_loss: 0.1004 - lr: 0.0010
Epoch 11/100

68/68 [==============================] - 3s 39ms/step - loss: 0.0887 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0843 - val_loss: 0.0961 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0779 - val_loss: 0.0909 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0834 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0727 - val_loss: 0.0811 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0702 - val_loss: 0.0750 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0692 - val_loss: 0.0718 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0685 - val_loss: 0.0699 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0659 - val_loss: 0.0675 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0641 - val_loss: 0.0648 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0655 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0616 - val_loss: 0.0657 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0606 - val_loss: 0.0649 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0593 - val_loss: 0.0645 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0598 - val_loss: 0.0639 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0596 - val_loss: 0.0636 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0595 - val_loss: 0.0619 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0591 - val_loss: 0.0594 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0598 - val_loss: 0.0572 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0580 - val_loss: 0.0571 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0578 - val_loss: 0.0565 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0576 - val_loss: 0.0561 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0560 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0570 - val_loss: 0.0558 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0572 - val_loss: 0.0558 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0572 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0560 - val_loss: 0.0557 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 15ms/step - loss: 0.0558 - val_loss: 0.0557 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0566 - val_loss: 0.0556 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0556 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0559 - val_loss: 0.0556 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0563 - val_loss: 0.0556 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0564 - val_loss: 0.0556 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0566 - val_loss: 0.0556 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0558 - val_loss: 0.0556 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0557 - val_loss: 0.0556 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 17ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0560 - val_loss: 0.0556 - lr: 2.8039e-15
Epoch 79/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0564 - val_loss: 0.0556 - lr: 1.3924e-15
Epoch 80/100
68/68 [==============================] - 1s 16ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 6.9144e-16
Epoch 1/100
85/85 [==============================] - 5s 23ms/step - loss: 0.2190 - val_loss: 0.1845 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1725 - val_loss: 0.1540 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 26ms/step - loss: 0.1469 - val_loss: 0.1374 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 22ms/step - loss: 0.1339 - val_loss: 0.1251 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1221 - val_loss: 0.1167 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1110 - val_loss: 0.1156 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1083 - val_loss: 0.1157 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 1s 16ms/step - loss: 0.1029 - val_loss: 0.1020 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0938 - val_loss: 0.0981 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0897 - val_loss: 0.0960 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 3s 32ms/step - loss: 0.0820 - val_loss: 0.0951 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 3s 39ms/step - loss: 0.0790 - val_loss: 0.0946 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0767 - val_loss: 0.0902 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0762 - val_loss: 0.0876 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0705 - val_loss: 0.0960 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0711 - val_loss: 0.0925 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0669 - val_loss: 0.0921 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0655 - val_loss: 0.0949 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0638 - val_loss: 0.0908 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0635 - val_loss: 0.0868 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0599 - val_loss: 0.0821 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0582 - val_loss: 0.0762 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0562 - val_loss: 0.0706 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0543 - val_loss: 0.0700 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0527 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0517 - val_loss: 0.0687 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0512 - val_loss: 0.0688 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0686 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0684 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0509 - val_loss: 0.0682 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0507 - val_loss: 0.0681 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0512 - val_loss: 0.0676 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0505 - val_loss: 0.0675 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0501 - val_loss: 0.0675 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0497 - val_loss: 0.0674 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0496 - val_loss: 0.0674 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0495 - val_loss: 0.0674 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0490 - val_loss: 0.0674 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0485 - val_loss: 0.0674 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0488 - val_loss: 0.0674 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0483 - val_loss: 0.0674 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0495 - val_loss: 0.0674 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0492 - val_loss: 0.0674 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 1s 13ms/step - loss: 0.0494 - val_loss: 0.0674 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0493 - val_loss: 0.0674 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0491 - val_loss: 0.0674 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 1s 14ms/step - loss: 0.0489 - val_loss: 0.0674 - lr: 3.0590e-10
Average Validation Loss: 0.0774694599211216
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 6s 116ms/step - loss: 0.2358 - val_loss: 0.2795 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 24ms/step - loss: 0.2389 - val_loss: 0.2613 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 23ms/step - loss: 0.2290 - val_loss: 0.2301 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 23ms/step - loss: 0.2115 - val_loss: 0.2233 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1990 - val_loss: 0.2236 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1910 - val_loss: 0.2195 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1840 - val_loss: 0.2083 - lr: 0.0010
Epoch 8/100

9/9 [==============================] - 0s 25ms/step - loss: 0.1751 - val_loss: 0.1999 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1665 - val_loss: 0.1904 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 22ms/step - loss: 0.1531 - val_loss: 0.1782 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1392 - val_loss: 0.1700 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1308 - val_loss: 0.1628 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1223 - val_loss: 0.1839 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1218 - val_loss: 0.1697 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1157 - val_loss: 0.1653 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1127 - val_loss: 0.1654 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1101 - val_loss: 0.1600 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1092 - val_loss: 0.1642 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1067 - val_loss: 0.1636 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1062 - val_loss: 0.1550 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1040 - val_loss: 0.1609 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1047 - val_loss: 0.1548 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 26ms/step - loss: 0.1008 - val_loss: 0.1537 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1004 - val_loss: 0.1555 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1007 - val_loss: 0.1540 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0997 - val_loss: 0.1551 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1012 - val_loss: 0.1518 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 23ms/step - loss: 0.1015 - val_loss: 0.1538 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0993 - val_loss: 0.1517 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1007 - val_loss: 0.1508 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 23ms/step - loss: 0.0996 - val_loss: 0.1529 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0986 - val_loss: 0.1536 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1004 - val_loss: 0.1538 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0991 - val_loss: 0.1537 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0993 - val_loss: 0.1530 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0981 - val_loss: 0.1525 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0978 - val_loss: 0.1524 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0982 - val_loss: 0.1524 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0991 - val_loss: 0.1523 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0983 - val_loss: 0.1523 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1004 - val_loss: 0.1522 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0981 - val_loss: 0.1522 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0973 - val_loss: 0.1522 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0991 - val_loss: 0.1522 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0991 - val_loss: 0.1522 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0985 - val_loss: 0.1522 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 33ms/step - loss: 0.0994 - val_loss: 0.1522 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1000 - val_loss: 0.1522 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 24ms/step - loss: 0.1000 - val_loss: 0.1522 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 24ms/step - loss: 0.0983 - val_loss: 0.1522 - lr: 4.5400e-08
Epoch 1/100
17/17 [==============================] - 3s 61ms/step - loss: 0.2596 - val_loss: 0.1981 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 14ms/step - loss: 0.2345 - val_loss: 0.1824 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 14ms/step - loss: 0.2138 - val_loss: 0.1637 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 15ms/step - loss: 0.2002 - val_loss: 0.1527 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1885 - val_loss: 0.1493 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1773 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1654 - val_loss: 0.1385 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1540 - val_loss: 0.1345 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1476 - val_loss: 0.1352 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1404 - val_loss: 0.1268 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1314 - val_loss: 0.1297 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1250 - val_loss: 0.1294 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1175 - val_loss: 0.1196 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1138 - val_loss: 0.1176 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1075 - val_loss: 0.1153 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 16ms/step - loss: 0.1039 - val_loss: 0.1092 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 15ms/step - loss: 0.1017 - val_loss: 0.1022 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0980 - val_loss: 0.0987 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0959 - val_loss: 0.1000 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0916 - val_loss: 0.1046 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0904 - val_loss: 0.1090 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0918 - val_loss: 0.1026 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0887 - val_loss: 0.0980 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0879 - val_loss: 0.0992 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0876 - val_loss: 0.1004 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0864 - val_loss: 0.1004 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0867 - val_loss: 0.0994 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0877 - val_loss: 0.0978 - lr: 7.4274e-05

Epoch 29/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0855 - val_loss: 0.0982 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0840 - val_loss: 0.1004 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0859 - val_loss: 0.0981 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0851 - val_loss: 0.0976 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0846 - val_loss: 0.0978 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0856 - val_loss: 0.0987 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0838 - val_loss: 0.0983 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 15ms/step - loss: 0.0858 - val_loss: 0.0978 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0860 - val_loss: 0.0978 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0855 - val_loss: 0.0977 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0855 - val_loss: 0.0978 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0846 - val_loss: 0.0977 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0851 - val_loss: 0.0976 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0862 - val_loss: 0.0977 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0849 - val_loss: 0.0977 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0843 - val_loss: 0.0977 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0860 - val_loss: 0.0977 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0843 - val_loss: 0.0978 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0841 - val_loss: 0.0978 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0847 - val_loss: 0.0978 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0851 - val_loss: 0.0978 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0852 - val_loss: 0.0978 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0841 - val_loss: 0.0978 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0855 - val_loss: 0.0978 - lr: 1.6702e-08
Epoch 1/100
26/26 [==============================] - 7s 73ms/step - loss: 0.2434 - val_loss: 0.2250 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 20ms/step - loss: 0.2067 - val_loss: 0.1915 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 19ms/step - loss: 0.1899 - val_loss: 0.1705 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1739 - val_loss: 0.1524 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 35ms/step - loss: 0.1585 - val_loss: 0.1390 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 39ms/step - loss: 0.1477 - val_loss: 0.1292 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 42ms/step - loss: 0.1335 - val_loss: 0.1180 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 37ms/step - loss: 0.1233 - val_loss: 0.1120 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 34ms/step - loss: 0.1140 - val_loss: 0.0986 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 34ms/step - loss: 0.1123 - val_loss: 0.1088 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 26ms/step - loss: 0.1062 - val_loss: 0.0924 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0996 - val_loss: 0.0935 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0947 - val_loss: 0.0868 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0903 - val_loss: 0.0889 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0883 - val_loss: 0.0818 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0863 - val_loss: 0.0825 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0842 - val_loss: 0.0795 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0834 - val_loss: 0.0800 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0808 - val_loss: 0.0781 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0800 - val_loss: 0.0777 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 38ms/step - loss: 0.0815 - val_loss: 0.0767 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0827 - val_loss: 0.0766 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0866 - val_loss: 0.0916 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0823 - val_loss: 0.0911 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0788 - val_loss: 0.0873 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0776 - val_loss: 0.0856 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0771 - val_loss: 0.0872 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0762 - val_loss: 0.0850 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0750 - val_loss: 0.0842 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 29ms/step - loss: 0.0758 - val_loss: 0.0849 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 34ms/step - loss: 0.0749 - val_loss: 0.0839 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0748 - val_loss: 0.0841 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0734 - val_loss: 0.0830 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0747 - val_loss: 0.0828 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0736 - val_loss: 0.0827 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0736 - val_loss: 0.0825 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0739 - val_loss: 0.0826 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0740 - val_loss: 0.0827 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0740 - val_loss: 0.0828 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0735 - val_loss: 0.0828 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0738 - val_loss: 0.0829 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0727 - val_loss: 0.0829 - lr: 1.1138e-06
Epoch 1/100
34/34 [==============================] - 9s 71ms/step - loss: 0.2248 - val_loss: 0.2195 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1928 - val_loss: 0.1871 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 28ms/step - loss: 0.1665 - val_loss: 0.1597 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1463 - val_loss: 0.1401 - lr: 0.0010
Epoch 5/100

34/34 [==============================] - 1s 25ms/step - loss: 0.1290 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1172 - val_loss: 0.1451 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1107 - val_loss: 0.1272 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1034 - val_loss: 0.1206 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0964 - val_loss: 0.1270 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0949 - val_loss: 0.1195 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0954 - val_loss: 0.1041 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0956 - val_loss: 0.0893 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0904 - val_loss: 0.0994 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0855 - val_loss: 0.0884 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0869 - val_loss: 0.0970 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0808 - val_loss: 0.0882 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0822 - val_loss: 0.1004 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0801 - val_loss: 0.0948 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0798 - val_loss: 0.1036 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0814 - val_loss: 0.1090 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0870 - val_loss: 0.1135 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0967 - val_loss: 0.0873 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0870 - val_loss: 0.0756 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0823 - val_loss: 0.0721 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0806 - val_loss: 0.0695 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0782 - val_loss: 0.0685 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0766 - val_loss: 0.0680 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0754 - val_loss: 0.0674 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0739 - val_loss: 0.0671 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0743 - val_loss: 0.0667 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0733 - val_loss: 0.0665 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0664 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0723 - val_loss: 0.0663 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0722 - val_loss: 0.0662 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0719 - val_loss: 0.0662 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0726 - val_loss: 0.0661 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0728 - val_loss: 0.0661 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0722 - val_loss: 0.0661 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0720 - val_loss: 0.0660 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0725 - val_loss: 0.0660 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0713 - val_loss: 0.0660 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0723 - val_loss: 0.0660 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0718 - val_loss: 0.0660 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0724 - val_loss: 0.0660 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0719 - val_loss: 0.0660 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0724 - val_loss: 0.0660 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0722 - val_loss: 0.0660 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0717 - val_loss: 0.0660 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0716 - val_loss: 0.0660 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0727 - val_loss: 0.0660 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0714 - val_loss: 0.0660 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0711 - val_loss: 0.0660 - lr: 4.6110e-14

Epoch 75/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0721 - val_loss: 0.0660 - lr: 2.2897e-14
Epoch 1/100
43/43 [==============================] - 6s 76ms/step - loss: 0.2236 - val_loss: 0.1967 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 2s 45ms/step - loss: 0.1878 - val_loss: 0.1728 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 31ms/step - loss: 0.1648 - val_loss: 0.1543 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 30ms/step - loss: 0.1486 - val_loss: 0.1422 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 29ms/step - loss: 0.1368 - val_loss: 0.1336 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 26ms/step - loss: 0.1296 - val_loss: 0.1277 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 26ms/step - loss: 0.1222 - val_loss: 0.1223 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1167 - val_loss: 0.1195 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 25ms/step - loss: 0.1102 - val_loss: 0.1172 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 24ms/step - loss: 0.1072 - val_loss: 0.1194 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 2s 41ms/step - loss: 0.1036 - val_loss: 0.1111 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0990 - val_loss: 0.1088 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0969 - val_loss: 0.1040 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0903 - val_loss: 0.0980 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0856 - val_loss: 0.0986 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0820 - val_loss: 0.0943 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0785 - val_loss: 0.0908 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0772 - val_loss: 0.0882 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 39ms/step - loss: 0.0737 - val_loss: 0.0864 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 2s 39ms/step - loss: 0.0721 - val_loss: 0.0845 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0707 - val_loss: 0.0831 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0692 - val_loss: 0.0832 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0676 - val_loss: 0.0824 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0664 - val_loss: 0.0813 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0653 - val_loss: 0.0807 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0644 - val_loss: 0.0796 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 2s 41ms/step - loss: 0.0645 - val_loss: 0.0790 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0640 - val_loss: 0.0786 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0642 - val_loss: 0.0783 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0635 - val_loss: 0.0773 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0633 - val_loss: 0.0770 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0631 - val_loss: 0.0767 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0626 - val_loss: 0.0766 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0624 - val_loss: 0.0765 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0630 - val_loss: 0.0764 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0623 - val_loss: 0.0763 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0626 - val_loss: 0.0762 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0618 - val_loss: 0.0762 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0628 - val_loss: 0.0762 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0620 - val_loss: 0.0762 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0624 - val_loss: 0.0762 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0621 - val_loss: 0.0762 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0613 - val_loss: 0.0762 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0627 - val_loss: 0.0762 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0762 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0615 - val_loss: 0.0762 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0625 - val_loss: 0.0762 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0622 - val_loss: 0.0762 - lr: 1.3816e-12

Epoch 70/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0630 - val_loss: 0.0762 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0619 - val_loss: 0.0762 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0623 - val_loss: 0.0762 - lr: 2.2897e-14
Epoch 76/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0629 - val_loss: 0.0762 - lr: 1.1370e-14
Epoch 77/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0627 - val_loss: 0.0762 - lr: 5.6464e-15
Average Validation Loss: 0.09343442767858505
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 7s 480ms/step - loss: 0.2401 - val_loss: 0.2560 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 74ms/step - loss: 0.2287 - val_loss: 0.2714 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 61ms/step - loss: 0.2349 - val_loss: 0.2642 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 71ms/step - loss: 0.2229 - val_loss: 0.2485 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 59ms/step - loss: 0.2177 - val_loss: 0.2348 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 51ms/step - loss: 0.2072 - val_loss: 0.2294 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 57ms/step - loss: 0.2001 - val_loss: 0.2277 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1911 - val_loss: 0.2252 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1875 - val_loss: 0.2142 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1738 - val_loss: 0.2022 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1602 - val_loss: 0.2016 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1504 - val_loss: 0.1877 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1449 - val_loss: 0.1968 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1391 - val_loss: 0.1911 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1361 - val_loss: 0.1888 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1335 - val_loss: 0.1979 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 62ms/step - loss: 0.1322 - val_loss: 0.1857 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1302 - val_loss: 0.1873 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1292 - val_loss: 0.1838 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1257 - val_loss: 0.1853 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1259 - val_loss: 0.1868 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 36ms/step - loss: 0.1252 - val_loss: 0.1801 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1240 - val_loss: 0.1807 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 57ms/step - loss: 0.1217 - val_loss: 0.1832 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1230 - val_loss: 0.1840 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1240 - val_loss: 0.1816 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1228 - val_loss: 0.1821 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1215 - val_loss: 0.1810 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 56ms/step - loss: 0.1236 - val_loss: 0.1799 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1231 - val_loss: 0.1792 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1205 - val_loss: 0.1795 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1193 - val_loss: 0.1800 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 78ms/step - loss: 0.1210 - val_loss: 0.1802 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1211 - val_loss: 0.1803 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 37ms/step - loss: 0.1208 - val_loss: 0.1805 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1204 - val_loss: 0.1805 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 65ms/step - loss: 0.1196 - val_loss: 0.1805 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1211 - val_loss: 0.1805 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 93ms/step - loss: 0.1201 - val_loss: 0.1806 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1220 - val_loss: 0.1806 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1209 - val_loss: 0.1805 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1209 - val_loss: 0.1805 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1213 - val_loss: 0.1805 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1212 - val_loss: 0.1805 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 38ms/step - loss: 0.1223 - val_loss: 0.1805 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 66ms/step - loss: 0.1214 - val_loss: 0.1805 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1229 - val_loss: 0.1805 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 65ms/step - loss: 0.1221 - val_loss: 0.1805 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1233 - val_loss: 0.1805 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1203 - val_loss: 0.1805 - lr: 4.5400e-08
Epoch 1/100
9/9 [==============================] - 8s 178ms/step - loss: 0.2578 - val_loss: 0.2002 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 42ms/step - loss: 0.2343 - val_loss: 0.1981 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 43ms/step - loss: 0.2179 - val_loss: 0.1942 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2068 - val_loss: 0.1709 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1917 - val_loss: 0.1855 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 1s 72ms/step - loss: 0.1795 - val_loss: 0.1813 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 1s 60ms/step - loss: 0.1750 - val_loss: 0.1709 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1609 - val_loss: 0.1794 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1574 - val_loss: 0.1749 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1536 - val_loss: 0.1563 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1459 - val_loss: 0.1555 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1380 - val_loss: 0.1613 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1358 - val_loss: 0.1474 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1331 - val_loss: 0.1378 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1275 - val_loss: 0.1431 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1236 - val_loss: 0.1360 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 1s 66ms/step - loss: 0.1215 - val_loss: 0.1355 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1192 - val_loss: 0.1318 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1169 - val_loss: 0.1289 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1162 - val_loss: 0.1253 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1143 - val_loss: 0.1289 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1138 - val_loss: 0.1230 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1111 - val_loss: 0.1236 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1113 - val_loss: 0.1236 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 36ms/step - loss: 0.1103 - val_loss: 0.1201 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1103 - val_loss: 0.1199 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1085 - val_loss: 0.1198 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1086 - val_loss: 0.1199 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1086 - val_loss: 0.1167 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1084 - val_loss: 0.1181 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 1s 43ms/step - loss: 0.1072 - val_loss: 0.1181 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1083 - val_loss: 0.1185 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1078 - val_loss: 0.1184 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1087 - val_loss: 0.1178 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1076 - val_loss: 0.1180 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1064 - val_loss: 0.1179 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1073 - val_loss: 0.1182 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1069 - val_loss: 0.1183 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1068 - val_loss: 0.1182 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1078 - val_loss: 0.1183 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 1s 62ms/step - loss: 0.1082 - val_loss: 0.1183 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 56ms/step - loss: 0.1077 - val_loss: 0.1183 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 57ms/step - loss: 0.1066 - val_loss: 0.1184 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1090 - val_loss: 0.1184 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1064 - val_loss: 0.1184 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 45ms/step - loss: 0.1089 - val_loss: 0.1183 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1075 - val_loss: 0.1183 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1055 - val_loss: 0.1183 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1079 - val_loss: 0.1183 - lr: 6.7729e-08
Epoch 1/100
13/13 [==============================] - 7s 168ms/step - loss: 0.2616 - val_loss: 0.2274 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 1s 54ms/step - loss: 0.2243 - val_loss: 0.2258 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 1s 57ms/step - loss: 0.2004 - val_loss: 0.2005 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1922 - val_loss: 0.1895 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1788 - val_loss: 0.1758 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 38ms/step - loss: 0.1696 - val_loss: 0.1635 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1616 - val_loss: 0.1541 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1535 - val_loss: 0.1473 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 39ms/step - loss: 0.1448 - val_loss: 0.1406 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1400 - val_loss: 0.1343 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1328 - val_loss: 0.1301 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1289 - val_loss: 0.1242 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1210 - val_loss: 0.1219 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1178 - val_loss: 0.1183 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 33ms/step - loss: 0.1161 - val_loss: 0.1150 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1163 - val_loss: 0.1112 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1094 - val_loss: 0.1091 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1048 - val_loss: 0.1073 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 32ms/step - loss: 0.1035 - val_loss: 0.1040 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1007 - val_loss: 0.1025 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0999 - val_loss: 0.1005 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0970 - val_loss: 0.0991 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0971 - val_loss: 0.0981 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0949 - val_loss: 0.0969 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0943 - val_loss: 0.0966 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0936 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0930 - val_loss: 0.0956 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0930 - val_loss: 0.0956 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0923 - val_loss: 0.0951 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0919 - val_loss: 0.0952 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0921 - val_loss: 0.0948 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0929 - val_loss: 0.0947 - lr: 2.7324e-05
Epoch 33/100

13/13 [==============================] - 0s 32ms/step - loss: 0.0912 - val_loss: 0.0947 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0923 - val_loss: 0.0946 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0915 - val_loss: 0.0945 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0912 - val_loss: 0.0945 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 1s 67ms/step - loss: 0.0916 - val_loss: 0.0944 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 1s 50ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 1s 44ms/step - loss: 0.0921 - val_loss: 0.0945 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0900 - val_loss: 0.0945 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 1s 48ms/step - loss: 0.0917 - val_loss: 0.0945 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 1s 41ms/step - loss: 0.0918 - val_loss: 0.0945 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 1s 42ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0916 - val_loss: 0.0945 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0910 - val_loss: 0.0945 - lr: 2.2487e-07
Epoch 47/100
13/13 [==============================] - 1s 51ms/step - loss: 0.0911 - val_loss: 0.0945 - lr: 1.5073e-07
Epoch 48/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0919 - val_loss: 0.0945 - lr: 1.0104e-07
Epoch 49/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0918 - val_loss: 0.0945 - lr: 6.7729e-08
Epoch 50/100
13/13 [==============================] - 0s 36ms/step - loss: 0.0913 - val_loss: 0.0944 - lr: 4.5400e-08
Epoch 51/100
13/13 [==============================] - 1s 43ms/step - loss: 0.0912 - val_loss: 0.0944 - lr: 2.7536e-08
Epoch 52/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0914 - val_loss: 0.0944 - lr: 1.6702e-08
Epoch 53/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0914 - val_loss: 0.0944 - lr: 1.0130e-08
Epoch 54/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0916 - val_loss: 0.0944 - lr: 6.1442e-09
Epoch 55/100
13/13 [==============================] - 0s 39ms/step - loss: 0.0919 - val_loss: 0.0944 - lr: 3.7267e-09
Epoch 56/100
13/13 [==============================] - 0s 38ms/step - loss: 0.0911 - val_loss: 0.0944 - lr: 2.2603e-09
Epoch 57/100
13/13 [==============================] - 1s 40ms/step - loss: 0.0913 - val_loss: 0.0944 - lr: 1.3710e-09
Epoch 1/100
17/17 [==============================] - 10s 126ms/step - loss: 0.2393 - val_loss: 0.2136 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 37ms/step - loss: 0.2117 - val_loss: 0.1987 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 1s 40ms/step - loss: 0.1903 - val_loss: 0.1918 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 1s 37ms/step - loss: 0.1770 - val_loss: 0.1906 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 1s 42ms/step - loss: 0.1674 - val_loss: 0.1763 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 1s 42ms/step - loss: 0.1572 - val_loss: 0.1624 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1464 - val_loss: 0.1567 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 38ms/step - loss: 0.1384 - val_loss: 0.1577 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 1s 48ms/step - loss: 0.1365 - val_loss: 0.1373 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 1s 40ms/step - loss: 0.1262 - val_loss: 0.1291 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 1s 38ms/step - loss: 0.1171 - val_loss: 0.1232 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 1s 39ms/step - loss: 0.1095 - val_loss: 0.1215 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 36ms/step - loss: 0.1044 - val_loss: 0.1279 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 35ms/step - loss: 0.1042 - val_loss: 0.1285 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 43ms/step - loss: 0.1077 - val_loss: 0.1243 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 44ms/step - loss: 0.1139 - val_loss: 0.0905 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0966 - val_loss: 0.0897 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0931 - val_loss: 0.0904 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0937 - val_loss: 0.0871 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0939 - val_loss: 0.0829 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0910 - val_loss: 0.0804 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0880 - val_loss: 0.0789 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0871 - val_loss: 0.0786 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0858 - val_loss: 0.0774 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 1s 47ms/step - loss: 0.0852 - val_loss: 0.0773 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0846 - val_loss: 0.0763 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0837 - val_loss: 0.0760 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0841 - val_loss: 0.0759 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0841 - val_loss: 0.0762 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0838 - val_loss: 0.0754 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0833 - val_loss: 0.0751 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0828 - val_loss: 0.0752 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0822 - val_loss: 0.0753 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0824 - val_loss: 0.0754 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0830 - val_loss: 0.0755 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 1s 56ms/step - loss: 0.0829 - val_loss: 0.0754 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 1s 43ms/step - loss: 0.0828 - val_loss: 0.0754 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0821 - val_loss: 0.0754 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0824 - val_loss: 0.0753 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0831 - val_loss: 0.0753 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0823 - val_loss: 0.0753 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0820 - val_loss: 0.0753 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0827 - val_loss: 0.0753 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 1s 51ms/step - loss: 0.0814 - val_loss: 0.0753 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 1s 53ms/step - loss: 0.0826 - val_loss: 0.0753 - lr: 3.3546e-07

Epoch 46/100
17/17 [==============================] - 1s 52ms/step - loss: 0.0836 - val_loss: 0.0752 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0816 - val_loss: 0.0752 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 1s 48ms/step - loss: 0.0824 - val_loss: 0.0752 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0824 - val_loss: 0.0752 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 78ms/step - loss: 0.0831 - val_loss: 0.0752 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 55ms/step - loss: 0.0826 - val_loss: 0.0752 - lr: 2.7536e-08
Epoch 1/100
22/22 [==============================] - 8s 94ms/step - loss: 0.2429 - val_loss: 0.2170 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 36ms/step - loss: 0.2103 - val_loss: 0.2022 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 39ms/step - loss: 0.1872 - val_loss: 0.1836 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 40ms/step - loss: 0.1709 - val_loss: 0.1711 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 37ms/step - loss: 0.1592 - val_loss: 0.1648 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1512 - val_loss: 0.1540 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1401 - val_loss: 0.1477 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 37ms/step - loss: 0.1323 - val_loss: 0.1421 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 42ms/step - loss: 0.1271 - val_loss: 0.1368 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 38ms/step - loss: 0.1210 - val_loss: 0.1332 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 36ms/step - loss: 0.1152 - val_loss: 0.1295 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 33ms/step - loss: 0.1117 - val_loss: 0.1268 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 35ms/step - loss: 0.1079 - val_loss: 0.1230 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1024 - val_loss: 0.1201 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0990 - val_loss: 0.1152 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0940 - val_loss: 0.1133 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0917 - val_loss: 0.1110 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0884 - val_loss: 0.1072 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0861 - val_loss: 0.1064 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0852 - val_loss: 0.1028 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0817 - val_loss: 0.0992 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0797 - val_loss: 0.0953 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0779 - val_loss: 0.0927 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0760 - val_loss: 0.0906 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0752 - val_loss: 0.0885 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0745 - val_loss: 0.0882 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0736 - val_loss: 0.0871 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0728 - val_loss: 0.0865 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0725 - val_loss: 0.0861 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0722 - val_loss: 0.0858 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0722 - val_loss: 0.0855 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 47ms/step - loss: 0.0710 - val_loss: 0.0853 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0714 - val_loss: 0.0852 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0722 - val_loss: 0.0851 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0720 - val_loss: 0.0851 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0707 - val_loss: 0.0850 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0716 - val_loss: 0.0850 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0716 - val_loss: 0.0849 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0701 - val_loss: 0.0849 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 49ms/step - loss: 0.0714 - val_loss: 0.0849 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 52ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 50ms/step - loss: 0.0706 - val_loss: 0.0849 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0702 - val_loss: 0.0849 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0706 - val_loss: 0.0849 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0710 - val_loss: 0.0849 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0708 - val_loss: 0.0849 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0709 - val_loss: 0.0849 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0709 - val_loss: 0.0849 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 2.7751e-11

Epoch 65/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0715 - val_loss: 0.0849 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0717 - val_loss: 0.0849 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0711 - val_loss: 0.0849 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0714 - val_loss: 0.0849 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0713 - val_loss: 0.0849 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0707 - val_loss: 0.0849 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0705 - val_loss: 0.0849 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0718 - val_loss: 0.0849 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0712 - val_loss: 0.0849 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0717 - val_loss: 0.0849 - lr: 1.1370e-14
Average Validation Loss: 0.110069240629673
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 6s 109ms/step - loss: 0.2105 - val_loss: 0.2637 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 1s 33ms/step - loss: 0.2267 - val_loss: 0.2137 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 1s 36ms/step - loss: 0.1925 - val_loss: 0.2056 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 1s 36ms/step - loss: 0.1821 - val_loss: 0.1984 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 1s 33ms/step - loss: 0.1747 - val_loss: 0.1864 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1594 - val_loss: 0.1818 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1443 - val_loss: 0.2007 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1588 - val_loss: 0.1570 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1294 - val_loss: 0.1572 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1108 - val_loss: 0.1549 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 1s 29ms/step - loss: 0.1131 - val_loss: 0.1568 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1061 - val_loss: 0.1687 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 1s 30ms/step - loss: 0.1073 - val_loss: 0.1525 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 33ms/step - loss: 0.1020 - val_loss: 0.1334 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 49ms/step - loss: 0.0988 - val_loss: 0.1287 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0969 - val_loss: 0.1537 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0985 - val_loss: 0.1448 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0914 - val_loss: 0.1314 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 38ms/step - loss: 0.0868 - val_loss: 0.1341 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0846 - val_loss: 0.1362 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0814 - val_loss: 0.1361 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0828 - val_loss: 0.1350 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0837 - val_loss: 0.1353 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0807 - val_loss: 0.1290 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0815 - val_loss: 0.1328 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0813 - val_loss: 0.1326 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0817 - val_loss: 0.1263 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0800 - val_loss: 0.1326 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0801 - val_loss: 0.1274 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 1s 42ms/step - loss: 0.0790 - val_loss: 0.1302 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0787 - val_loss: 0.1292 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0781 - val_loss: 0.1289 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0770 - val_loss: 0.1287 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0785 - val_loss: 0.1287 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0778 - val_loss: 0.1300 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0794 - val_loss: 0.1308 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0777 - val_loss: 0.1311 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0776 - val_loss: 0.1312 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0774 - val_loss: 0.1312 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0796 - val_loss: 0.1312 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0789 - val_loss: 0.1312 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0794 - val_loss: 0.1311 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0779 - val_loss: 0.1310 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0771 - val_loss: 0.1310 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 1s 29ms/step - loss: 0.0775 - val_loss: 0.1311 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0783 - val_loss: 0.1311 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0778 - val_loss: 0.1310 - lr: 1.5073e-07
Epoch 1/100
34/34 [==============================] - 7s 77ms/step - loss: 0.2445 - val_loss: 0.1781 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 28ms/step - loss: 0.2142 - val_loss: 0.1568 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1939 - val_loss: 0.1423 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 28ms/step - loss: 0.1826 - val_loss: 0.1276 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 30ms/step - loss: 0.1699 - val_loss: 0.1248 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 43ms/step - loss: 0.1590 - val_loss: 0.1134 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 37ms/step - loss: 0.1533 - val_loss: 0.1178 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 35ms/step - loss: 0.1475 - val_loss: 0.1045 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1398 - val_loss: 0.1332 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1352 - val_loss: 0.1054 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1348 - val_loss: 0.1271 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1279 - val_loss: 0.0882 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 36ms/step - loss: 0.1223 - val_loss: 0.1150 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 34ms/step - loss: 0.1170 - val_loss: 0.0994 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 42ms/step - loss: 0.1146 - val_loss: 0.1084 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1065 - val_loss: 0.1033 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1025 - val_loss: 0.1055 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0983 - val_loss: 0.0962 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0950 - val_loss: 0.0978 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0916 - val_loss: 0.0911 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0874 - val_loss: 0.0892 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0834 - val_loss: 0.0829 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0824 - val_loss: 0.0812 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0771 - val_loss: 0.0832 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0768 - val_loss: 0.0850 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0736 - val_loss: 0.0874 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0743 - val_loss: 0.0877 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0729 - val_loss: 0.0846 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0728 - val_loss: 0.0847 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0731 - val_loss: 0.0872 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0729 - val_loss: 0.0872 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0734 - val_loss: 0.0894 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0732 - val_loss: 0.0900 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0715 - val_loss: 0.0888 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0708 - val_loss: 0.0885 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0710 - val_loss: 0.0874 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0706 - val_loss: 0.0877 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0716 - val_loss: 0.0879 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0703 - val_loss: 0.0878 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0706 - val_loss: 0.0880 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 2s 51ms/step - loss: 0.0704 - val_loss: 0.0880 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0707 - val_loss: 0.0879 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0720 - val_loss: 0.0880 - lr: 7.4659e-07
Epoch 1/100
51/51 [==============================] - 14s 80ms/step - loss: 0.2222 - val_loss: 0.1963 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1915 - val_loss: 0.1703 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 2s 30ms/step - loss: 0.1717 - val_loss: 0.1534 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 25ms/step - loss: 0.1559 - val_loss: 0.1420 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1469 - val_loss: 0.1356 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 24ms/step - loss: 0.1397 - val_loss: 0.1305 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 29ms/step - loss: 0.1367 - val_loss: 0.1265 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 2s 35ms/step - loss: 0.1307 - val_loss: 0.1243 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 2s 33ms/step - loss: 0.1245 - val_loss: 0.1136 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 27ms/step - loss: 0.1225 - val_loss: 0.1166 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 2s 31ms/step - loss: 0.1172 - val_loss: 0.1060 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 27ms/step - loss: 0.1118 - val_loss: 0.1093 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 2s 32ms/step - loss: 0.1083 - val_loss: 0.1010 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0994 - val_loss: 0.0966 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0964 - val_loss: 0.0943 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0910 - val_loss: 0.0860 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0884 - val_loss: 0.0878 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0834 - val_loss: 0.0809 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0781 - val_loss: 0.0781 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0755 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0745 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0708 - val_loss: 0.0735 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0677 - val_loss: 0.0731 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0697 - val_loss: 0.0725 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 17ms/step - loss: 0.0686 - val_loss: 0.0706 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0686 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0661 - val_loss: 0.0672 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0665 - val_loss: 0.0663 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0653 - val_loss: 0.0664 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0636 - val_loss: 0.0661 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0633 - val_loss: 0.0659 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0620 - val_loss: 0.0658 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0632 - val_loss: 0.0658 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0619 - val_loss: 0.0660 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 2s 41ms/step - loss: 0.0626 - val_loss: 0.0659 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 2s 36ms/step - loss: 0.0618 - val_loss: 0.0658 - lr: 8.2297e-06

Epoch 37/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0631 - val_loss: 0.0657 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 2s 33ms/step - loss: 0.0625 - val_loss: 0.0658 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0617 - val_loss: 0.0658 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0614 - val_loss: 0.0658 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0622 - val_loss: 0.0658 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0658 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0613 - val_loss: 0.0658 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 3.3546e-07
Epoch 46/100
51/51 [==============================] - 2s 38ms/step - loss: 0.0621 - val_loss: 0.0658 - lr: 2.2487e-07
Epoch 47/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0626 - val_loss: 0.0658 - lr: 1.5073e-07
Epoch 48/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0615 - val_loss: 0.0658 - lr: 1.0104e-07
Epoch 49/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0614 - val_loss: 0.0658 - lr: 6.7729e-08
Epoch 50/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0613 - val_loss: 0.0658 - lr: 4.5400e-08
Epoch 51/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0610 - val_loss: 0.0658 - lr: 2.7536e-08
Epoch 52/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0616 - val_loss: 0.0658 - lr: 1.6702e-08
Epoch 53/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0624 - val_loss: 0.0658 - lr: 1.0130e-08
Epoch 54/100
51/51 [==============================] - 2s 30ms/step - loss: 0.0620 - val_loss: 0.0658 - lr: 6.1442e-09
Epoch 55/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0611 - val_loss: 0.0658 - lr: 3.7267e-09
Epoch 56/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0612 - val_loss: 0.0658 - lr: 2.2603e-09
Epoch 57/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0612 - val_loss: 0.0658 - lr: 1.3710e-09
Epoch 1/100
68/68 [==============================] - 6s 34ms/step - loss: 0.2187 - val_loss: 0.2108 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1811 - val_loss: 0.1916 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1591 - val_loss: 0.1479 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 18ms/step - loss: 0.1416 - val_loss: 0.1608 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 20ms/step - loss: 0.1371 - val_loss: 0.1275 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 2s 27ms/step - loss: 0.1240 - val_loss: 0.1235 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 2s 28ms/step - loss: 0.1192 - val_loss: 0.1131 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 2s 25ms/step - loss: 0.1089 - val_loss: 0.1200 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1046 - val_loss: 0.1306 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1008 - val_loss: 0.1175 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0940 - val_loss: 0.1112 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0874 - val_loss: 0.0990 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0825 - val_loss: 0.0904 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0787 - val_loss: 0.0868 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0773 - val_loss: 0.0825 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0742 - val_loss: 0.0776 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0709 - val_loss: 0.0762 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0700 - val_loss: 0.0718 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0685 - val_loss: 0.0718 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0667 - val_loss: 0.0711 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0658 - val_loss: 0.0693 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0636 - val_loss: 0.0672 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0630 - val_loss: 0.0688 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0612 - val_loss: 0.0701 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0616 - val_loss: 0.0675 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0614 - val_loss: 0.0676 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0616 - val_loss: 0.0642 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0605 - val_loss: 0.0623 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0608 - val_loss: 0.0586 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0592 - val_loss: 0.0579 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0589 - val_loss: 0.0568 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0587 - val_loss: 0.0563 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0584 - val_loss: 0.0561 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0575 - val_loss: 0.0558 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0576 - val_loss: 0.0557 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0557 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0577 - val_loss: 0.0558 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0571 - val_loss: 0.0557 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0557 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0570 - val_loss: 0.0557 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0577 - val_loss: 0.0556 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0573 - val_loss: 0.0556 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0561 - val_loss: 0.0556 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0582 - val_loss: 0.0556 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 6.7729e-08

Epoch 50/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0574 - val_loss: 0.0556 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0571 - val_loss: 0.0556 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0572 - val_loss: 0.0556 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0578 - val_loss: 0.0556 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0574 - val_loss: 0.0556 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0577 - val_loss: 0.0556 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0581 - val_loss: 0.0556 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 3s 37ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 2s 32ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0568 - val_loss: 0.0556 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 2s 36ms/step - loss: 0.0573 - val_loss: 0.0556 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 2s 37ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 3s 37ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 2s 31ms/step - loss: 0.0569 - val_loss: 0.0556 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0565 - val_loss: 0.0556 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0562 - val_loss: 0.0556 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 2s 29ms/step - loss: 0.0578 - val_loss: 0.0556 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0575 - val_loss: 0.0556 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0579 - val_loss: 0.0556 - lr: 1.1370e-14
Epoch 77/100
68/68 [==============================] - 3s 40ms/step - loss: 0.0576 - val_loss: 0.0556 - lr: 5.6464e-15
Epoch 78/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0570 - val_loss: 0.0556 - lr: 2.8039e-15
Epoch 1/100
85/85 [==============================] - 12s 51ms/step - loss: 0.2168 - val_loss: 0.1819 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 3s 33ms/step - loss: 0.1751 - val_loss: 0.1562 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 23ms/step - loss: 0.1522 - val_loss: 0.1418 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 1s 17ms/step - loss: 0.1374 - val_loss: 0.1327 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1287 - val_loss: 0.1248 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 3s 33ms/step - loss: 0.1207 - val_loss: 0.1194 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1139 - val_loss: 0.1190 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 22ms/step - loss: 0.1105 - val_loss: 0.1112 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0963 - val_loss: 0.1045 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0919 - val_loss: 0.1001 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0873 - val_loss: 0.0959 - lr: 9.0484e-04
Epoch 12/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0815 - val_loss: 0.0911 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0783 - val_loss: 0.0879 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0741 - val_loss: 0.0871 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0758 - val_loss: 0.0832 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0703 - val_loss: 0.0813 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0683 - val_loss: 0.0800 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0656 - val_loss: 0.0781 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0659 - val_loss: 0.0761 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0630 - val_loss: 0.0763 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0616 - val_loss: 0.0754 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0602 - val_loss: 0.0718 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0581 - val_loss: 0.0704 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0565 - val_loss: 0.0699 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0556 - val_loss: 0.0687 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0538 - val_loss: 0.0680 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0519 - val_loss: 0.0674 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0528 - val_loss: 0.0679 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0522 - val_loss: 0.0676 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0512 - val_loss: 0.0669 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0519 - val_loss: 0.0671 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0511 - val_loss: 0.0670 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0517 - val_loss: 0.0668 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0515 - val_loss: 0.0667 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0515 - val_loss: 0.0665 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0509 - val_loss: 0.0664 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0518 - val_loss: 0.0663 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 3s 35ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.6616e-06

Epoch 42/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 3s 30ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0503 - val_loss: 0.0663 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0507 - val_loss: 0.0663 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 28ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0512 - val_loss: 0.0663 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 8.3153e-10
Epoch 59/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 5.0435e-10
Epoch 60/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 3.0590e-10
Epoch 61/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 1.6788e-10
Epoch 62/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 9.2136e-11
Epoch 63/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0500 - val_loss: 0.0663 - lr: 5.0565e-11
Epoch 64/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0511 - val_loss: 0.0663 - lr: 2.7751e-11
Epoch 65/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0498 - val_loss: 0.0663 - lr: 1.5230e-11
Epoch 66/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 8.3584e-12
Epoch 67/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0510 - val_loss: 0.0663 - lr: 4.5872e-12
Epoch 68/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0515 - val_loss: 0.0663 - lr: 2.5175e-12
Epoch 69/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0508 - val_loss: 0.0663 - lr: 1.3816e-12
Epoch 70/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0506 - val_loss: 0.0663 - lr: 7.5826e-13
Epoch 71/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 3.7654e-13
Epoch 72/100
85/85 [==============================] - 1s 16ms/step - loss: 0.0514 - val_loss: 0.0663 - lr: 1.8698e-13
Epoch 73/100
85/85 [==============================] - 1s 15ms/step - loss: 0.0513 - val_loss: 0.0663 - lr: 9.2853e-14
Epoch 74/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0505 - val_loss: 0.0663 - lr: 4.6110e-14
Epoch 75/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 2.2897e-14
Epoch 76/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0509 - val_loss: 0.0663 - lr: 1.1370e-14
Epoch 77/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0502 - val_loss: 0.0663 - lr: 5.6464e-15
Average Validation Loss: 0.07903297692537307
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 64
Epoch 1/100
9/9 [==============================] - 8s 208ms/step - loss: 0.2174 - val_loss: 0.2670 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 1s 67ms/step - loss: 0.2264 - val_loss: 0.2464 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 44ms/step - loss: 0.2146 - val_loss: 0.2102 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1948 - val_loss: 0.2043 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1796 - val_loss: 0.2085 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1790 - val_loss: 0.1949 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 1s 60ms/step - loss: 0.1639 - val_loss: 0.1847 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1517 - val_loss: 0.1733 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 55ms/step - loss: 0.1376 - val_loss: 0.1616 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1275 - val_loss: 0.1608 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1218 - val_loss: 0.1919 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1302 - val_loss: 0.1677 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1168 - val_loss: 0.1509 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1122 - val_loss: 0.1702 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 54ms/step - loss: 0.1121 - val_loss: 0.1570 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1106 - val_loss: 0.1491 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1074 - val_loss: 0.1585 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1041 - val_loss: 0.1503 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 56ms/step - loss: 0.1012 - val_loss: 0.1511 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1037 - val_loss: 0.1461 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1005 - val_loss: 0.1521 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 47ms/step - loss: 0.1009 - val_loss: 0.1461 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0980 - val_loss: 0.1453 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0994 - val_loss: 0.1423 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0977 - val_loss: 0.1498 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1001 - val_loss: 0.1488 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0979 - val_loss: 0.1454 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0964 - val_loss: 0.1438 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0980 - val_loss: 0.1469 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0980 - val_loss: 0.1460 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0966 - val_loss: 0.1449 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 42ms/step - loss: 0.0964 - val_loss: 0.1447 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0963 - val_loss: 0.1447 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0972 - val_loss: 0.1448 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 51ms/step - loss: 0.0966 - val_loss: 0.1446 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 58ms/step - loss: 0.0963 - val_loss: 0.1449 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 57ms/step - loss: 0.0963 - val_loss: 0.1448 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 46ms/step - loss: 0.0972 - val_loss: 0.1446 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0959 - val_loss: 0.1445 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 47ms/step - loss: 0.0956 - val_loss: 0.1445 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0964 - val_loss: 0.1445 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0967 - val_loss: 0.1445 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0965 - val_loss: 0.1444 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0961 - val_loss: 0.1444 - lr: 5.0045e-07
Epoch 1/100
17/17 [==============================] - 5s 67ms/step - loss: 0.2384 - val_loss: 0.1803 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.2152 - val_loss: 0.1717 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1975 - val_loss: 0.1483 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1870 - val_loss: 0.1440 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1735 - val_loss: 0.1420 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1666 - val_loss: 0.1273 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 1s 32ms/step - loss: 0.1517 - val_loss: 0.1335 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 28ms/step - loss: 0.1364 - val_loss: 0.1464 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1407 - val_loss: 0.1105 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1403 - val_loss: 0.1083 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.1202 - val_loss: 0.1136 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1127 - val_loss: 0.1189 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 1s 30ms/step - loss: 0.1113 - val_loss: 0.1088 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1089 - val_loss: 0.0963 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 24ms/step - loss: 0.1048 - val_loss: 0.0917 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 23ms/step - loss: 0.1024 - val_loss: 0.0913 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0976 - val_loss: 0.0934 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0923 - val_loss: 0.0929 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0894 - val_loss: 0.0897 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0888 - val_loss: 0.0884 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0868 - val_loss: 0.0888 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0863 - val_loss: 0.0954 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0852 - val_loss: 0.0899 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0838 - val_loss: 0.0910 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0849 - val_loss: 0.0875 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0818 - val_loss: 0.0882 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0832 - val_loss: 0.0887 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0817 - val_loss: 0.0884 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0829 - val_loss: 0.0881 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0816 - val_loss: 0.0892 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0822 - val_loss: 0.0889 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0814 - val_loss: 0.0892 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0821 - val_loss: 0.0886 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0816 - val_loss: 0.0878 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0812 - val_loss: 0.0883 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0816 - val_loss: 0.0889 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0823 - val_loss: 0.0891 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0819 - val_loss: 0.0893 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0823 - val_loss: 0.0892 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0819 - val_loss: 0.0891 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0825 - val_loss: 0.0891 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0824 - val_loss: 0.0891 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0804 - val_loss: 0.0891 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0808 - val_loss: 0.0892 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0823 - val_loss: 0.0891 - lr: 3.3546e-07
Epoch 1/100
26/26 [==============================] - 6s 64ms/step - loss: 0.2216 - val_loss: 0.2172 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 28ms/step - loss: 0.1979 - val_loss: 0.1879 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1828 - val_loss: 0.1760 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1681 - val_loss: 0.1578 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1587 - val_loss: 0.1457 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1478 - val_loss: 0.1333 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1408 - val_loss: 0.1276 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1327 - val_loss: 0.1196 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1255 - val_loss: 0.1135 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1195 - val_loss: 0.1034 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.1118 - val_loss: 0.1023 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 27ms/step - loss: 0.1040 - val_loss: 0.0888 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 24ms/step - loss: 0.1026 - val_loss: 0.0944 - lr: 7.4082e-04
Epoch 14/100

26/26 [==============================] - 1s 25ms/step - loss: 0.0959 - val_loss: 0.0832 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0920 - val_loss: 0.0839 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0904 - val_loss: 0.0816 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0884 - val_loss: 0.0814 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 48ms/step - loss: 0.0866 - val_loss: 0.0801 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 47ms/step - loss: 0.0856 - val_loss: 0.0807 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 44ms/step - loss: 0.0853 - val_loss: 0.0794 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 50ms/step - loss: 0.0847 - val_loss: 0.0776 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0872 - val_loss: 0.0746 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 52ms/step - loss: 0.0853 - val_loss: 0.0782 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 42ms/step - loss: 0.0831 - val_loss: 0.0814 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 45ms/step - loss: 0.0806 - val_loss: 0.0812 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 31ms/step - loss: 0.0793 - val_loss: 0.0816 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0774 - val_loss: 0.0793 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 42ms/step - loss: 0.0772 - val_loss: 0.0800 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0764 - val_loss: 0.0792 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0770 - val_loss: 0.0806 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0764 - val_loss: 0.0788 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0742 - val_loss: 0.0787 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0753 - val_loss: 0.0783 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0790 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 1s 28ms/step - loss: 0.0754 - val_loss: 0.0788 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 1s 43ms/step - loss: 0.0757 - val_loss: 0.0787 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 1s 36ms/step - loss: 0.0749 - val_loss: 0.0787 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0756 - val_loss: 0.0787 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0747 - val_loss: 0.0786 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 1s 30ms/step - loss: 0.0756 - val_loss: 0.0786 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0749 - val_loss: 0.0787 - lr: 1.6616e-06
Epoch 42/100
26/26 [==============================] - 1s 35ms/step - loss: 0.0754 - val_loss: 0.0787 - lr: 1.1138e-06
Epoch 1/100
34/34 [==============================] - 6s 51ms/step - loss: 0.2307 - val_loss: 0.1994 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1920 - val_loss: 0.2005 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 24ms/step - loss: 0.1738 - val_loss: 0.1736 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 26ms/step - loss: 0.1557 - val_loss: 0.1587 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 39ms/step - loss: 0.1425 - val_loss: 0.1458 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 32ms/step - loss: 0.1330 - val_loss: 0.1392 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 31ms/step - loss: 0.1254 - val_loss: 0.1299 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1194 - val_loss: 0.1205 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 25ms/step - loss: 0.1121 - val_loss: 0.1152 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1060 - val_loss: 0.1113 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 33ms/step - loss: 0.1019 - val_loss: 0.1081 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0975 - val_loss: 0.1078 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0956 - val_loss: 0.1023 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0906 - val_loss: 0.1042 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0885 - val_loss: 0.1002 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0875 - val_loss: 0.1066 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0863 - val_loss: 0.1072 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0851 - val_loss: 0.1128 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0874 - val_loss: 0.1222 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0899 - val_loss: 0.1270 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0918 - val_loss: 0.1233 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0949 - val_loss: 0.1046 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0900 - val_loss: 0.0960 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0859 - val_loss: 0.0883 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0827 - val_loss: 0.0871 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0810 - val_loss: 0.0834 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0791 - val_loss: 0.0822 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0793 - val_loss: 0.0803 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0778 - val_loss: 0.0796 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0771 - val_loss: 0.0793 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0758 - val_loss: 0.0787 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0773 - val_loss: 0.0784 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0762 - val_loss: 0.0784 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 23ms/step - loss: 0.0757 - val_loss: 0.0784 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0756 - val_loss: 0.0781 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0762 - val_loss: 0.0780 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0754 - val_loss: 0.0779 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0752 - val_loss: 0.0779 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0753 - val_loss: 0.0780 - lr: 1.6616e-06

Epoch 42/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0758 - val_loss: 0.0780 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0748 - val_loss: 0.0779 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0756 - val_loss: 0.0779 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0750 - val_loss: 0.0779 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0754 - val_loss: 0.0779 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0753 - val_loss: 0.0779 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0747 - val_loss: 0.0779 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0758 - val_loss: 0.0779 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 25ms/step - loss: 0.0748 - val_loss: 0.0779 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0751 - val_loss: 0.0779 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0760 - val_loss: 0.0779 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0749 - val_loss: 0.0779 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0753 - val_loss: 0.0779 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0749 - val_loss: 0.0779 - lr: 1.3710e-09
Epoch 1/100
43/43 [==============================] - 5s 43ms/step - loss: 0.2166 - val_loss: 0.1927 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1780 - val_loss: 0.1676 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 1s 20ms/step - loss: 0.1607 - val_loss: 0.1575 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1382 - val_loss: 0.1429 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1300 - val_loss: 0.1380 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 1s 17ms/step - loss: 0.1227 - val_loss: 0.1315 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 1s 18ms/step - loss: 0.1106 - val_loss: 0.1252 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 1s 19ms/step - loss: 0.1052 - val_loss: 0.1200 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0993 - val_loss: 0.1149 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0962 - val_loss: 0.1126 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 1s 23ms/step - loss: 0.1036 - val_loss: 0.1150 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0987 - val_loss: 0.1084 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0928 - val_loss: 0.1061 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0897 - val_loss: 0.1031 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0855 - val_loss: 0.1009 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0819 - val_loss: 0.0985 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0785 - val_loss: 0.0961 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0747 - val_loss: 0.0932 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0742 - val_loss: 0.0905 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0716 - val_loss: 0.0892 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0701 - val_loss: 0.0879 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0683 - val_loss: 0.0869 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0668 - val_loss: 0.0854 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0654 - val_loss: 0.0844 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0648 - val_loss: 0.0829 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0638 - val_loss: 0.0824 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0643 - val_loss: 0.0821 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0645 - val_loss: 0.0816 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0647 - val_loss: 0.0801 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0639 - val_loss: 0.0789 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0640 - val_loss: 0.0785 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0636 - val_loss: 0.0780 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0629 - val_loss: 0.0780 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0622 - val_loss: 0.0779 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0630 - val_loss: 0.0779 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0623 - val_loss: 0.0777 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0618 - val_loss: 0.0777 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0620 - val_loss: 0.0777 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0623 - val_loss: 0.0777 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0613 - val_loss: 0.0776 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0614 - val_loss: 0.0776 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 2s 40ms/step - loss: 0.0622 - val_loss: 0.0776 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0632 - val_loss: 0.0776 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0625 - val_loss: 0.0776 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0622 - val_loss: 0.0776 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0614 - val_loss: 0.0776 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0618 - val_loss: 0.0776 - lr: 6.1442e-09

Epoch 55/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0612 - val_loss: 0.0776 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 8.3153e-10
Epoch 59/100
43/43 [==============================] - 1s 30ms/step - loss: 0.0621 - val_loss: 0.0776 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0627 - val_loss: 0.0776 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0624 - val_loss: 0.0776 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 34ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0616 - val_loss: 0.0776 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 33ms/step - loss: 0.0623 - val_loss: 0.0776 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 29ms/step - loss: 0.0625 - val_loss: 0.0776 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0615 - val_loss: 0.0776 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0617 - val_loss: 0.0776 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0621 - val_loss: 0.0776 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 27ms/step - loss: 0.0620 - val_loss: 0.0776 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0629 - val_loss: 0.0776 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0616 - val_loss: 0.0776 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0619 - val_loss: 0.0776 - lr: 4.6110e-14
Epoch 75/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0627 - val_loss: 0.0776 - lr: 2.2897e-14
Average Validation Loss: 0.09198872447013855
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 0.0001, l2_reg: 1e-05, batch_size: 128
Epoch 1/100
5/5 [==============================] - 6s 333ms/step - loss: 0.3206 - val_loss: 0.2487 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 72ms/step - loss: 0.2163 - val_loss: 0.2454 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 50ms/step - loss: 0.2198 - val_loss: 0.2582 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 50ms/step - loss: 0.2229 - val_loss: 0.2514 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 42ms/step - loss: 0.2140 - val_loss: 0.2332 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 45ms/step - loss: 0.2038 - val_loss: 0.2168 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1943 - val_loss: 0.2104 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1837 - val_loss: 0.2134 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1830 - val_loss: 0.2141 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1780 - val_loss: 0.2062 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 76ms/step - loss: 0.1707 - val_loss: 0.1963 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 72ms/step - loss: 0.1610 - val_loss: 0.1930 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 69ms/step - loss: 0.1508 - val_loss: 0.1843 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 59ms/step - loss: 0.1462 - val_loss: 0.1803 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 69ms/step - loss: 0.1407 - val_loss: 0.1891 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1416 - val_loss: 0.1716 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 61ms/step - loss: 0.1349 - val_loss: 0.1805 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 45ms/step - loss: 0.1354 - val_loss: 0.1726 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1298 - val_loss: 0.1735 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1282 - val_loss: 0.1784 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1279 - val_loss: 0.1743 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1263 - val_loss: 0.1728 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1257 - val_loss: 0.1720 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 63ms/step - loss: 0.1241 - val_loss: 0.1731 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 57ms/step - loss: 0.1237 - val_loss: 0.1724 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 52ms/step - loss: 0.1250 - val_loss: 0.1705 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1227 - val_loss: 0.1697 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 68ms/step - loss: 0.1213 - val_loss: 0.1699 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1215 - val_loss: 0.1699 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 67ms/step - loss: 0.1217 - val_loss: 0.1705 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1206 - val_loss: 0.1706 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 75ms/step - loss: 0.1209 - val_loss: 0.1699 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1221 - val_loss: 0.1693 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1211 - val_loss: 0.1691 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1207 - val_loss: 0.1691 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 51ms/step - loss: 0.1206 - val_loss: 0.1692 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1208 - val_loss: 0.1691 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1218 - val_loss: 0.1691 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 53ms/step - loss: 0.1229 - val_loss: 0.1691 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1222 - val_loss: 0.1691 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 56ms/step - loss: 0.1215 - val_loss: 0.1692 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1202 - val_loss: 0.1692 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1210 - val_loss: 0.1692 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1220 - val_loss: 0.1692 - lr: 5.0045e-07
Epoch 45/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1202 - val_loss: 0.1692 - lr: 3.3546e-07
Epoch 46/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1204 - val_loss: 0.1692 - lr: 2.2487e-07
Epoch 47/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1214 - val_loss: 0.1692 - lr: 1.5073e-07
Epoch 48/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1212 - val_loss: 0.1692 - lr: 1.0104e-07
Epoch 49/100
5/5 [==============================] - 0s 49ms/step - loss: 0.1196 - val_loss: 0.1692 - lr: 6.7729e-08
Epoch 50/100
5/5 [==============================] - 0s 58ms/step - loss: 0.1206 - val_loss: 0.1692 - lr: 4.5400e-08
Epoch 51/100
5/5 [==============================] - 0s 54ms/step - loss: 0.1203 - val_loss: 0.1692 - lr: 2.7536e-08
Epoch 52/100
5/5 [==============================] - 0s 55ms/step - loss: 0.1203 - val_loss: 0.1692 - lr: 1.6702e-08
Epoch 53/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1231 - val_loss: 0.1692 - lr: 1.0130e-08
Epoch 54/100
5/5 [==============================] - 0s 46ms/step - loss: 0.1198 - val_loss: 0.1692 - lr: 6.1442e-09
Epoch 55/100
5/5 [==============================] - 0s 48ms/step - loss: 0.1218 - val_loss: 0.1692 - lr: 3.7267e-09
Epoch 56/100
5/5 [==============================] - 0s 42ms/step - loss: 0.1241 - val_loss: 0.1692 - lr: 2.2603e-09
Epoch 57/100
5/5 [==============================] - 0s 47ms/step - loss: 0.1224 - val_loss: 0.1692 - lr: 1.3710e-09
Epoch 58/100
5/5 [==============================] - 0s 62ms/step - loss: 0.1225 - val_loss: 0.1692 - lr: 8.3153e-10
Epoch 59/100
5/5 [==============================] - 0s 60ms/step - loss: 0.1201 - val_loss: 0.1692 - lr: 5.0435e-10
Epoch 1/100
9/9 [==============================] - 4s 142ms/step - loss: 0.2511 - val_loss: 0.1882 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 42ms/step - loss: 0.2289 - val_loss: 0.1777 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 34ms/step - loss: 0.2123 - val_loss: 0.1760 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1994 - val_loss: 0.1660 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 38ms/step - loss: 0.1906 - val_loss: 0.1555 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 32ms/step - loss: 0.1792 - val_loss: 0.1627 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 37ms/step - loss: 0.1679 - val_loss: 0.1575 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 40ms/step - loss: 0.1588 - val_loss: 0.1503 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 48ms/step - loss: 0.1526 - val_loss: 0.1495 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1432 - val_loss: 0.1415 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1388 - val_loss: 0.1433 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1320 - val_loss: 0.1398 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 1s 61ms/step - loss: 0.1303 - val_loss: 0.1255 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 49ms/step - loss: 0.1256 - val_loss: 0.1300 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1208 - val_loss: 0.1207 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 54ms/step - loss: 0.1178 - val_loss: 0.1187 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1151 - val_loss: 0.1175 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 51ms/step - loss: 0.1110 - val_loss: 0.1125 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1093 - val_loss: 0.1117 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1077 - val_loss: 0.1093 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1059 - val_loss: 0.1116 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1039 - val_loss: 0.1066 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 50ms/step - loss: 0.1035 - val_loss: 0.1066 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1023 - val_loss: 0.1049 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1021 - val_loss: 0.1049 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 43ms/step - loss: 0.1015 - val_loss: 0.1061 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 42ms/step - loss: 0.1010 - val_loss: 0.1075 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 52ms/step - loss: 0.1010 - val_loss: 0.1053 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1010 - val_loss: 0.1048 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 44ms/step - loss: 0.1006 - val_loss: 0.1057 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 44ms/step - loss: 0.0995 - val_loss: 0.1043 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0998 - val_loss: 0.1037 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 41ms/step - loss: 0.1004 - val_loss: 0.1042 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0998 - val_loss: 0.1044 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1047 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 49ms/step - loss: 0.0988 - val_loss: 0.1046 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 46ms/step - loss: 0.1002 - val_loss: 0.1046 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 48ms/step - loss: 0.0995 - val_loss: 0.1048 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0989 - val_loss: 0.1048 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 54ms/step - loss: 0.0991 - val_loss: 0.1048 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 49ms/step - loss: 0.0993 - val_loss: 0.1048 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0994 - val_loss: 0.1048 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 35ms/step - loss: 0.1000 - val_loss: 0.1048 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0993 - val_loss: 0.1048 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 48ms/step - loss: 0.0997 - val_loss: 0.1048 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 39ms/step - loss: 0.1000 - val_loss: 0.1048 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0992 - val_loss: 0.1048 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 39ms/step - loss: 0.0997 - val_loss: 0.1048 - lr: 4.5400e-08
Epoch 51/100
9/9 [==============================] - 0s 41ms/step - loss: 0.0998 - val_loss: 0.1048 - lr: 2.7536e-08
Epoch 52/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0996 - val_loss: 0.1048 - lr: 1.6702e-08
Epoch 1/100
13/13 [==============================] - 5s 96ms/step - loss: 0.2693 - val_loss: 0.2221 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 33ms/step - loss: 0.2174 - val_loss: 0.2171 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 30ms/step - loss: 0.2011 - val_loss: 0.2051 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 30ms/step - loss: 0.1820 - val_loss: 0.1797 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 29ms/step - loss: 0.1714 - val_loss: 0.1573 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1592 - val_loss: 0.1400 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 34ms/step - loss: 0.1536 - val_loss: 0.1300 - lr: 0.0010
Epoch 8/100

13/13 [==============================] - 0s 34ms/step - loss: 0.1447 - val_loss: 0.1285 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 36ms/step - loss: 0.1329 - val_loss: 0.1165 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1263 - val_loss: 0.1074 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 1s 44ms/step - loss: 0.1228 - val_loss: 0.1031 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 1s 38ms/step - loss: 0.1181 - val_loss: 0.1066 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 38ms/step - loss: 0.1111 - val_loss: 0.1046 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 37ms/step - loss: 0.1084 - val_loss: 0.1033 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 31ms/step - loss: 0.1032 - val_loss: 0.0967 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0999 - val_loss: 0.0930 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0994 - val_loss: 0.0926 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0980 - val_loss: 0.0978 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0963 - val_loss: 0.0928 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0937 - val_loss: 0.0886 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0925 - val_loss: 0.0901 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0909 - val_loss: 0.0878 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0906 - val_loss: 0.0875 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0892 - val_loss: 0.0869 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0886 - val_loss: 0.0887 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0885 - val_loss: 0.0843 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0882 - val_loss: 0.0875 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0882 - val_loss: 0.0850 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0889 - val_loss: 0.0853 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0877 - val_loss: 0.0855 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0876 - val_loss: 0.0858 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0868 - val_loss: 0.0856 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0871 - val_loss: 0.0855 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0874 - val_loss: 0.0859 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0881 - val_loss: 0.0856 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0870 - val_loss: 0.0853 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0866 - val_loss: 0.0853 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0859 - val_loss: 0.0853 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0866 - val_loss: 0.0854 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0873 - val_loss: 0.0854 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0877 - val_loss: 0.0854 - lr: 1.6616e-06
Epoch 42/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0872 - val_loss: 0.0854 - lr: 1.1138e-06
Epoch 43/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0878 - val_loss: 0.0854 - lr: 7.4659e-07
Epoch 44/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0875 - val_loss: 0.0854 - lr: 5.0045e-07
Epoch 45/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0870 - val_loss: 0.0855 - lr: 3.3546e-07
Epoch 46/100
13/13 [==============================] - 1s 47ms/step - loss: 0.0877 - val_loss: 0.0855 - lr: 2.2487e-07
Epoch 1/100
17/17 [==============================] - 5s 86ms/step - loss: 0.2339 - val_loss: 0.2107 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 1s 33ms/step - loss: 0.2028 - val_loss: 0.2006 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1849 - val_loss: 0.1958 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1724 - val_loss: 0.1958 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1658 - val_loss: 0.1779 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1591 - val_loss: 0.1519 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1444 - val_loss: 0.1500 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 1s 31ms/step - loss: 0.1350 - val_loss: 0.1556 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1346 - val_loss: 0.1459 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1312 - val_loss: 0.1287 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1200 - val_loss: 0.1196 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1116 - val_loss: 0.1191 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1076 - val_loss: 0.1165 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1058 - val_loss: 0.1149 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1062 - val_loss: 0.1062 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 28ms/step - loss: 0.1018 - val_loss: 0.1004 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0980 - val_loss: 0.0976 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0963 - val_loss: 0.0927 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0934 - val_loss: 0.0920 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0929 - val_loss: 0.0886 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0925 - val_loss: 0.0849 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0902 - val_loss: 0.0801 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0886 - val_loss: 0.0787 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0865 - val_loss: 0.0779 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0864 - val_loss: 0.0758 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0854 - val_loss: 0.0760 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0850 - val_loss: 0.0754 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0851 - val_loss: 0.0742 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0843 - val_loss: 0.0742 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0842 - val_loss: 0.0737 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0735 - lr: 3.6883e-05
Epoch 32/100

17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0735 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0836 - val_loss: 0.0733 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0834 - val_loss: 0.0731 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0835 - val_loss: 0.0731 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0841 - val_loss: 0.0730 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0837 - val_loss: 0.0729 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0833 - val_loss: 0.0728 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 1s 28ms/step - loss: 0.0831 - val_loss: 0.0728 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0839 - val_loss: 0.0728 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0831 - val_loss: 0.0728 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0838 - val_loss: 0.0727 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0832 - val_loss: 0.0727 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0835 - val_loss: 0.0727 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0837 - val_loss: 0.0727 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0839 - val_loss: 0.0727 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0843 - val_loss: 0.0727 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0830 - val_loss: 0.0727 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 46ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 54ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0835 - val_loss: 0.0727 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 1s 42ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0826 - val_loss: 0.0727 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 39ms/step - loss: 0.0842 - val_loss: 0.0727 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0841 - val_loss: 0.0727 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0839 - val_loss: 0.0727 - lr: 5.0565e-11
Epoch 64/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0834 - val_loss: 0.0727 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0832 - val_loss: 0.0727 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0838 - val_loss: 0.0727 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0826 - val_loss: 0.0727 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0837 - val_loss: 0.0727 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 40ms/step - loss: 0.0831 - val_loss: 0.0727 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0840 - val_loss: 0.0727 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 4.6110e-14
Epoch 75/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0836 - val_loss: 0.0727 - lr: 2.2897e-14
Epoch 1/100
22/22 [==============================] - 5s 61ms/step - loss: 0.2268 - val_loss: 0.2045 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 27ms/step - loss: 0.2032 - val_loss: 0.1910 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1842 - val_loss: 0.1755 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1731 - val_loss: 0.1675 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1645 - val_loss: 0.1622 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1514 - val_loss: 0.1488 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 25ms/step - loss: 0.1406 - val_loss: 0.1384 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1335 - val_loss: 0.1368 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 30ms/step - loss: 0.1334 - val_loss: 0.1371 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 31ms/step - loss: 0.1274 - val_loss: 0.1335 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 34ms/step - loss: 0.1223 - val_loss: 0.1313 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 33ms/step - loss: 0.1172 - val_loss: 0.1287 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1137 - val_loss: 0.1227 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 26ms/step - loss: 0.1063 - val_loss: 0.1186 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1027 - val_loss: 0.1184 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1004 - val_loss: 0.1166 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0963 - val_loss: 0.1125 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0936 - val_loss: 0.1097 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 55ms/step - loss: 0.0907 - val_loss: 0.1071 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 2s 76ms/step - loss: 0.0876 - val_loss: 0.1038 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 43ms/step - loss: 0.0848 - val_loss: 0.1003 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0824 - val_loss: 0.0968 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0805 - val_loss: 0.0938 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0783 - val_loss: 0.0905 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0774 - val_loss: 0.0889 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 53ms/step - loss: 0.0757 - val_loss: 0.0880 - lr: 1.1080e-04

Epoch 27/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0755 - val_loss: 0.0875 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 2s 85ms/step - loss: 0.0747 - val_loss: 0.0869 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0738 - val_loss: 0.0868 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0740 - val_loss: 0.0863 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 45ms/step - loss: 0.0737 - val_loss: 0.0859 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 38ms/step - loss: 0.0739 - val_loss: 0.0859 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0735 - val_loss: 0.0858 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0734 - val_loss: 0.0856 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 41ms/step - loss: 0.0735 - val_loss: 0.0856 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 48ms/step - loss: 0.0736 - val_loss: 0.0855 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0741 - val_loss: 0.0854 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0732 - val_loss: 0.0854 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0736 - val_loss: 0.0854 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0737 - val_loss: 0.0854 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0738 - val_loss: 0.0854 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0739 - val_loss: 0.0853 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0731 - val_loss: 0.0853 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 44ms/step - loss: 0.0730 - val_loss: 0.0853 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0744 - val_loss: 0.0853 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0739 - val_loss: 0.0853 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0745 - val_loss: 0.0853 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0733 - val_loss: 0.0853 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0736 - val_loss: 0.0853 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0732 - val_loss: 0.0853 - lr: 5.0435e-10
Epoch 60/100
22/22 [==============================] - 1s 35ms/step - loss: 0.0729 - val_loss: 0.0853 - lr: 3.0590e-10
Epoch 61/100
22/22 [==============================] - 1s 56ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 1.6788e-10
Epoch 62/100
22/22 [==============================] - 1s 52ms/step - loss: 0.0744 - val_loss: 0.0853 - lr: 9.2136e-11
Epoch 63/100
22/22 [==============================] - 1s 51ms/step - loss: 0.0735 - val_loss: 0.0853 - lr: 5.0565e-11
Epoch 64/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 2.7751e-11
Epoch 65/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 1.5230e-11
Epoch 66/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0736 - val_loss: 0.0853 - lr: 8.3584e-12
Epoch 67/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 4.5872e-12
Epoch 68/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 2.5175e-12
Epoch 69/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0740 - val_loss: 0.0853 - lr: 1.3816e-12
Epoch 70/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0731 - val_loss: 0.0853 - lr: 7.5826e-13
Epoch 71/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 3.7654e-13
Epoch 72/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0741 - val_loss: 0.0853 - lr: 1.8698e-13
Epoch 73/100
22/22 [==============================] - 1s 40ms/step - loss: 0.0737 - val_loss: 0.0853 - lr: 9.2853e-14
Epoch 74/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0738 - val_loss: 0.0853 - lr: 4.6110e-14
Epoch 75/100
22/22 [==============================] - 1s 31ms/step - loss: 0.0735 - val_loss: 0.0853 - lr: 2.2897e-14
Epoch 76/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0732 - val_loss: 0.0853 - lr: 1.1370e-14
Epoch 77/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0727 - val_loss: 0.0853 - lr: 5.6464e-15
Average Validation Loss: 0.1030262440443039
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 32
Epoch 1/100
18/18 [==============================] - 7s 79ms/step - loss: 0.1120 - val_loss: 0.1848 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 24ms/step - loss: 0.1383 - val_loss: 0.1331 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 22ms/step - loss: 0.1155 - val_loss: 0.1359 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1135 - val_loss: 0.1295 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 21ms/step - loss: 0.1058 - val_loss: 0.1302 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0967 - val_loss: 0.1517 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 27ms/step - loss: 0.1147 - val_loss: 0.1161 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0818 - val_loss: 0.1206 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0678 - val_loss: 0.1594 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0844 - val_loss: 0.1297 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0798 - val_loss: 0.1052 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0666 - val_loss: 0.1023 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 1s 30ms/step - loss: 0.0609 - val_loss: 0.1024 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 1s 35ms/step - loss: 0.0554 - val_loss: 0.1038 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 1s 48ms/step - loss: 0.0527 - val_loss: 0.1108 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 1s 65ms/step - loss: 0.0557 - val_loss: 0.0968 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0531 - val_loss: 0.1044 - lr: 4.9659e-04

Epoch 18/100
18/18 [==============================] - 1s 53ms/step - loss: 0.0502 - val_loss: 0.0991 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0492 - val_loss: 0.1001 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 64ms/step - loss: 0.0485 - val_loss: 0.0956 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 1s 55ms/step - loss: 0.0484 - val_loss: 0.1062 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 1s 53ms/step - loss: 0.0464 - val_loss: 0.1000 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 1s 47ms/step - loss: 0.0461 - val_loss: 0.0999 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0484 - val_loss: 0.1014 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 1s 42ms/step - loss: 0.0468 - val_loss: 0.0965 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 1s 37ms/step - loss: 0.0479 - val_loss: 0.0963 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 1s 54ms/step - loss: 0.0467 - val_loss: 0.0943 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0457 - val_loss: 0.0955 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 1s 34ms/step - loss: 0.0451 - val_loss: 0.0963 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0468 - val_loss: 0.0975 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 1s 36ms/step - loss: 0.0452 - val_loss: 0.0965 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0439 - val_loss: 0.0961 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 24ms/step - loss: 0.0446 - val_loss: 0.0941 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0460 - val_loss: 0.0939 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0460 - val_loss: 0.0944 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0438 - val_loss: 0.0947 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0454 - val_loss: 0.0951 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0456 - val_loss: 0.0952 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0463 - val_loss: 0.0952 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0455 - val_loss: 0.0951 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0443 - val_loss: 0.0953 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0444 - val_loss: 0.0954 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0457 - val_loss: 0.0954 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0452 - val_loss: 0.0954 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0465 - val_loss: 0.0954 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0456 - val_loss: 0.0954 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0446 - val_loss: 0.0954 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0445 - val_loss: 0.0954 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 28ms/step - loss: 0.0440 - val_loss: 0.0954 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 1s 31ms/step - loss: 0.0442 - val_loss: 0.0954 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 1s 28ms/step - loss: 0.0464 - val_loss: 0.0954 - lr: 2.7536e-08
Epoch 52/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0466 - val_loss: 0.0954 - lr: 1.6702e-08
Epoch 53/100
18/18 [==============================] - 0s 26ms/step - loss: 0.0476 - val_loss: 0.0954 - lr: 1.0130e-08
Epoch 54/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0460 - val_loss: 0.0954 - lr: 6.1442e-09
Epoch 1/100
34/34 [==============================] - 4s 42ms/step - loss: 0.1461 - val_loss: 0.1080 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1351 - val_loss: 0.0780 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1286 - val_loss: 0.0936 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1224 - val_loss: 0.0689 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1213 - val_loss: 0.0809 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1161 - val_loss: 0.0666 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1102 - val_loss: 0.0791 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 15ms/step - loss: 0.1052 - val_loss: 0.0675 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1076 - val_loss: 0.0789 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1000 - val_loss: 0.0788 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 15ms/step - loss: 0.1000 - val_loss: 0.0635 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0921 - val_loss: 0.0891 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0837 - val_loss: 0.0951 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0844 - val_loss: 0.0652 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0854 - val_loss: 0.0630 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0768 - val_loss: 0.0648 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0720 - val_loss: 0.0595 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0672 - val_loss: 0.0621 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0620 - val_loss: 0.0641 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0623 - val_loss: 0.0608 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0594 - val_loss: 0.0579 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0584 - val_loss: 0.0589 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0551 - val_loss: 0.0591 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0547 - val_loss: 0.0613 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0536 - val_loss: 0.0665 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0522 - val_loss: 0.0650 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0518 - val_loss: 0.0645 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 15ms/step - loss: 0.0505 - val_loss: 0.0635 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0517 - val_loss: 0.0656 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0508 - val_loss: 0.0669 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 20ms/step - loss: 0.0509 - val_loss: 0.0659 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 18ms/step - loss: 0.0505 - val_loss: 0.0668 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 19ms/step - loss: 0.0499 - val_loss: 0.0664 - lr: 2.0242e-05

Epoch 34/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0496 - val_loss: 0.0669 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0500 - val_loss: 0.0675 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0498 - val_loss: 0.0676 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 15ms/step - loss: 0.0501 - val_loss: 0.0676 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0502 - val_loss: 0.0675 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 14ms/step - loss: 0.0499 - val_loss: 0.0673 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0487 - val_loss: 0.0673 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 13ms/step - loss: 0.0497 - val_loss: 0.0673 - lr: 1.6616e-06
Epoch 1/100
51/51 [==============================] - 6s 57ms/step - loss: 0.1302 - val_loss: 0.1176 - lr: 0.0010
Epoch 2/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1189 - val_loss: 0.1099 - lr: 0.0010
Epoch 3/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1151 - val_loss: 0.1058 - lr: 0.0010
Epoch 4/100
51/51 [==============================] - 1s 19ms/step - loss: 0.1105 - val_loss: 0.1035 - lr: 0.0010
Epoch 5/100
51/51 [==============================] - 1s 20ms/step - loss: 0.1083 - val_loss: 0.1018 - lr: 0.0010
Epoch 6/100
51/51 [==============================] - 1s 21ms/step - loss: 0.1042 - val_loss: 0.0966 - lr: 0.0010
Epoch 7/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0998 - val_loss: 0.0983 - lr: 0.0010
Epoch 8/100
51/51 [==============================] - 1s 23ms/step - loss: 0.1014 - val_loss: 0.0951 - lr: 0.0010
Epoch 9/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0966 - val_loss: 0.0921 - lr: 0.0010
Epoch 10/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0914 - val_loss: 0.0861 - lr: 0.0010
Epoch 11/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0886 - val_loss: 0.0826 - lr: 9.0484e-04
Epoch 12/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0798 - val_loss: 0.0770 - lr: 8.1873e-04
Epoch 13/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0743 - val_loss: 0.0678 - lr: 7.4082e-04
Epoch 14/100
51/51 [==============================] - 1s 29ms/step - loss: 0.0692 - val_loss: 0.0717 - lr: 6.7032e-04
Epoch 15/100
51/51 [==============================] - 1s 25ms/step - loss: 0.0668 - val_loss: 0.0599 - lr: 6.0653e-04
Epoch 16/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0620 - val_loss: 0.0666 - lr: 5.4881e-04
Epoch 17/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0612 - val_loss: 0.0608 - lr: 4.9659e-04
Epoch 18/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0587 - val_loss: 0.0619 - lr: 4.4933e-04
Epoch 19/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0567 - val_loss: 0.0584 - lr: 4.0657e-04
Epoch 20/100
51/51 [==============================] - 2s 32ms/step - loss: 0.0568 - val_loss: 0.0603 - lr: 3.6788e-04
Epoch 21/100
51/51 [==============================] - 1s 28ms/step - loss: 0.0568 - val_loss: 0.0608 - lr: 3.0119e-04
Epoch 22/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0599 - val_loss: 0.0592 - lr: 2.4660e-04
Epoch 23/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0589 - val_loss: 0.0559 - lr: 2.0190e-04
Epoch 24/100
51/51 [==============================] - 1s 22ms/step - loss: 0.0587 - val_loss: 0.0527 - lr: 1.6530e-04
Epoch 25/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0572 - val_loss: 0.0519 - lr: 1.3534e-04
Epoch 26/100
51/51 [==============================] - 1s 26ms/step - loss: 0.0546 - val_loss: 0.0522 - lr: 1.1080e-04
Epoch 27/100
51/51 [==============================] - 1s 24ms/step - loss: 0.0535 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0521 - val_loss: 0.0531 - lr: 7.4274e-05
Epoch 29/100
51/51 [==============================] - 1s 23ms/step - loss: 0.0507 - val_loss: 0.0526 - lr: 6.0810e-05
Epoch 30/100
51/51 [==============================] - 1s 27ms/step - loss: 0.0500 - val_loss: 0.0534 - lr: 4.9787e-05
Epoch 31/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0494 - val_loss: 0.0534 - lr: 3.6883e-05
Epoch 32/100
51/51 [==============================] - 1s 21ms/step - loss: 0.0497 - val_loss: 0.0532 - lr: 2.7324e-05
Epoch 33/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0484 - val_loss: 0.0532 - lr: 2.0242e-05
Epoch 34/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0484 - val_loss: 0.0534 - lr: 1.4996e-05
Epoch 35/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0491 - val_loss: 0.0534 - lr: 1.1109e-05
Epoch 36/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0480 - val_loss: 0.0537 - lr: 8.2297e-06
Epoch 37/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0477 - val_loss: 0.0538 - lr: 6.0967e-06
Epoch 38/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0470 - val_loss: 0.0539 - lr: 4.5166e-06
Epoch 39/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0484 - val_loss: 0.0538 - lr: 3.3460e-06
Epoch 40/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0478 - val_loss: 0.0537 - lr: 2.4788e-06
Epoch 41/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0472 - val_loss: 0.0537 - lr: 1.6616e-06
Epoch 42/100
51/51 [==============================] - 1s 18ms/step - loss: 0.0470 - val_loss: 0.0537 - lr: 1.1138e-06
Epoch 43/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0483 - val_loss: 0.0537 - lr: 7.4659e-07
Epoch 44/100
51/51 [==============================] - 1s 19ms/step - loss: 0.0476 - val_loss: 0.0537 - lr: 5.0045e-07
Epoch 45/100
51/51 [==============================] - 1s 20ms/step - loss: 0.0485 - val_loss: 0.0537 - lr: 3.3546e-07
Epoch 1/100
68/68 [==============================] - 7s 43ms/step - loss: 0.1305 - val_loss: 0.1397 - lr: 0.0010
Epoch 2/100
68/68 [==============================] - 1s 17ms/step - loss: 0.1216 - val_loss: 0.1151 - lr: 0.0010
Epoch 3/100
68/68 [==============================] - 1s 22ms/step - loss: 0.1123 - val_loss: 0.1129 - lr: 0.0010
Epoch 4/100
68/68 [==============================] - 1s 21ms/step - loss: 0.1062 - val_loss: 0.1000 - lr: 0.0010
Epoch 5/100
68/68 [==============================] - 1s 19ms/step - loss: 0.1014 - val_loss: 0.1030 - lr: 0.0010
Epoch 6/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0980 - val_loss: 0.0923 - lr: 0.0010
Epoch 7/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0894 - val_loss: 0.0849 - lr: 0.0010
Epoch 8/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0857 - val_loss: 0.0848 - lr: 0.0010
Epoch 9/100
68/68 [==============================] - 3s 38ms/step - loss: 0.0815 - val_loss: 0.0857 - lr: 0.0010
Epoch 10/100
68/68 [==============================] - 3s 49ms/step - loss: 0.0761 - val_loss: 0.0859 - lr: 0.0010
Epoch 11/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0723 - val_loss: 0.0802 - lr: 9.0484e-04
Epoch 12/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0692 - val_loss: 0.0695 - lr: 8.1873e-04
Epoch 13/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0638 - val_loss: 0.0695 - lr: 7.4082e-04
Epoch 14/100
68/68 [==============================] - 3s 42ms/step - loss: 0.0610 - val_loss: 0.0730 - lr: 6.7032e-04
Epoch 15/100
68/68 [==============================] - 3s 44ms/step - loss: 0.0591 - val_loss: 0.0656 - lr: 6.0653e-04
Epoch 16/100
68/68 [==============================] - 3s 46ms/step - loss: 0.0583 - val_loss: 0.0622 - lr: 5.4881e-04
Epoch 17/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0547 - val_loss: 0.0616 - lr: 4.9659e-04
Epoch 18/100
68/68 [==============================] - 3s 39ms/step - loss: 0.0543 - val_loss: 0.0625 - lr: 4.4933e-04
Epoch 19/100
68/68 [==============================] - 2s 34ms/step - loss: 0.0534 - val_loss: 0.0600 - lr: 4.0657e-04
Epoch 20/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0512 - val_loss: 0.0593 - lr: 3.6788e-04
Epoch 21/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0511 - val_loss: 0.0610 - lr: 3.0119e-04
Epoch 22/100
68/68 [==============================] - 2s 35ms/step - loss: 0.0493 - val_loss: 0.0606 - lr: 2.4660e-04
Epoch 23/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0495 - val_loss: 0.0608 - lr: 2.0190e-04
Epoch 24/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0478 - val_loss: 0.0583 - lr: 1.6530e-04
Epoch 25/100
68/68 [==============================] - 2s 26ms/step - loss: 0.0482 - val_loss: 0.0591 - lr: 1.3534e-04
Epoch 26/100
68/68 [==============================] - 2s 28ms/step - loss: 0.0485 - val_loss: 0.0574 - lr: 1.1080e-04
Epoch 27/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0483 - val_loss: 0.0537 - lr: 9.0718e-05
Epoch 28/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0469 - val_loss: 0.0516 - lr: 7.4274e-05
Epoch 29/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0478 - val_loss: 0.0504 - lr: 6.0810e-05
Epoch 30/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0475 - val_loss: 0.0491 - lr: 4.9787e-05
Epoch 31/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0466 - val_loss: 0.0485 - lr: 3.6883e-05
Epoch 32/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0455 - val_loss: 0.0482 - lr: 2.7324e-05
Epoch 33/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0446 - val_loss: 0.0480 - lr: 2.0242e-05
Epoch 34/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0449 - val_loss: 0.0479 - lr: 1.4996e-05
Epoch 35/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0449 - val_loss: 0.0478 - lr: 1.1109e-05
Epoch 36/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0445 - val_loss: 0.0477 - lr: 8.2297e-06
Epoch 37/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0442 - val_loss: 0.0476 - lr: 6.0967e-06
Epoch 38/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0476 - lr: 4.5166e-06
Epoch 39/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0435 - val_loss: 0.0476 - lr: 3.3460e-06
Epoch 40/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0453 - val_loss: 0.0476 - lr: 2.4788e-06
Epoch 41/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0476 - lr: 1.6616e-06
Epoch 42/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 1.1138e-06
Epoch 43/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0475 - lr: 7.4659e-07
Epoch 44/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 5.0045e-07
Epoch 45/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 3.3546e-07
Epoch 46/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 2.2487e-07
Epoch 47/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.5073e-07
Epoch 48/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0433 - val_loss: 0.0475 - lr: 1.0104e-07
Epoch 49/100
68/68 [==============================] - 2s 30ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 6.7729e-08
Epoch 50/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 4.5400e-08
Epoch 51/100
68/68 [==============================] - 2s 33ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 2.7536e-08
Epoch 52/100
68/68 [==============================] - 2s 25ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.6702e-08
Epoch 53/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0450 - val_loss: 0.0475 - lr: 1.0130e-08
Epoch 54/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 6.1442e-09
Epoch 55/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 3.7267e-09
Epoch 56/100
68/68 [==============================] - 2s 23ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 2.2603e-09
Epoch 57/100
68/68 [==============================] - 2s 27ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 1.3710e-09
Epoch 58/100
68/68 [==============================] - 1s 22ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 8.3153e-10
Epoch 59/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0447 - val_loss: 0.0475 - lr: 5.0435e-10
Epoch 60/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0451 - val_loss: 0.0475 - lr: 3.0590e-10
Epoch 61/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0475 - lr: 1.6788e-10
Epoch 62/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 9.2136e-11
Epoch 63/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0475 - lr: 5.0565e-11
Epoch 64/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 2.7751e-11
Epoch 65/100
68/68 [==============================] - 2s 24ms/step - loss: 0.0439 - val_loss: 0.0475 - lr: 1.5230e-11
Epoch 66/100
68/68 [==============================] - 1s 19ms/step - loss: 0.0438 - val_loss: 0.0475 - lr: 8.3584e-12
Epoch 67/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 4.5872e-12
Epoch 68/100
68/68 [==============================] - 1s 21ms/step - loss: 0.0443 - val_loss: 0.0475 - lr: 2.5175e-12
Epoch 69/100
68/68 [==============================] - 2s 22ms/step - loss: 0.0441 - val_loss: 0.0475 - lr: 1.3816e-12
Epoch 70/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 7.5826e-13
Epoch 71/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0437 - val_loss: 0.0475 - lr: 3.7654e-13
Epoch 72/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0445 - val_loss: 0.0475 - lr: 1.8698e-13
Epoch 73/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0433 - val_loss: 0.0475 - lr: 9.2853e-14
Epoch 74/100
68/68 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0475 - lr: 4.6110e-14
Epoch 75/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0434 - val_loss: 0.0475 - lr: 2.2897e-14
Epoch 76/100
68/68 [==============================] - 1s 20ms/step - loss: 0.0444 - val_loss: 0.0475 - lr: 1.1370e-14
Epoch 1/100
85/85 [==============================] - 6s 33ms/step - loss: 0.1284 - val_loss: 0.1113 - lr: 0.0010
Epoch 2/100
85/85 [==============================] - 2s 25ms/step - loss: 0.1117 - val_loss: 0.1021 - lr: 0.0010
Epoch 3/100
85/85 [==============================] - 2s 20ms/step - loss: 0.1004 - val_loss: 0.0939 - lr: 0.0010
Epoch 4/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0941 - val_loss: 0.0893 - lr: 0.0010
Epoch 5/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0891 - val_loss: 0.0912 - lr: 0.0010
Epoch 6/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0839 - val_loss: 0.0833 - lr: 0.0010
Epoch 7/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0790 - val_loss: 0.0758 - lr: 0.0010
Epoch 8/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0699 - val_loss: 0.0751 - lr: 0.0010
Epoch 9/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0697 - val_loss: 0.0692 - lr: 0.0010
Epoch 10/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0649 - val_loss: 0.0692 - lr: 0.0010
Epoch 11/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0640 - val_loss: 0.0662 - lr: 9.0484e-04

Epoch 12/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0587 - val_loss: 0.0700 - lr: 8.1873e-04
Epoch 13/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0600 - val_loss: 0.0672 - lr: 7.4082e-04
Epoch 14/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0562 - val_loss: 0.0690 - lr: 6.7032e-04
Epoch 15/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0549 - val_loss: 0.0680 - lr: 6.0653e-04
Epoch 16/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0531 - val_loss: 0.0674 - lr: 5.4881e-04
Epoch 17/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0546 - val_loss: 0.0642 - lr: 4.9659e-04
Epoch 18/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0516 - val_loss: 0.0625 - lr: 4.4933e-04
Epoch 19/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0495 - val_loss: 0.0591 - lr: 4.0657e-04
Epoch 20/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0480 - val_loss: 0.0590 - lr: 3.6788e-04
Epoch 21/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0470 - val_loss: 0.0577 - lr: 3.0119e-04
Epoch 22/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0451 - val_loss: 0.0565 - lr: 2.4660e-04
Epoch 23/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0433 - val_loss: 0.0545 - lr: 2.0190e-04
Epoch 24/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0416 - val_loss: 0.0529 - lr: 1.6530e-04
Epoch 25/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0410 - val_loss: 0.0529 - lr: 1.3534e-04
Epoch 26/100
85/85 [==============================] - 1s 17ms/step - loss: 0.0401 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0393 - val_loss: 0.0523 - lr: 9.0718e-05
Epoch 28/100
85/85 [==============================] - 1s 18ms/step - loss: 0.0391 - val_loss: 0.0519 - lr: 7.4274e-05
Epoch 29/100
85/85 [==============================] - 2s 19ms/step - loss: 0.0392 - val_loss: 0.0513 - lr: 6.0810e-05
Epoch 30/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0395 - val_loss: 0.0513 - lr: 4.9787e-05
Epoch 31/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0392 - val_loss: 0.0507 - lr: 3.6883e-05
Epoch 32/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0386 - val_loss: 0.0501 - lr: 2.7324e-05
Epoch 33/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0394 - val_loss: 0.0500 - lr: 2.0242e-05
Epoch 34/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0386 - val_loss: 0.0500 - lr: 1.4996e-05
Epoch 35/100
85/85 [==============================] - 2s 23ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 1.1109e-05
Epoch 36/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0377 - val_loss: 0.0500 - lr: 8.2297e-06
Epoch 37/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0381 - val_loss: 0.0499 - lr: 6.0967e-06
Epoch 38/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0386 - val_loss: 0.0499 - lr: 4.5166e-06
Epoch 39/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0390 - val_loss: 0.0499 - lr: 3.3460e-06
Epoch 40/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0384 - val_loss: 0.0499 - lr: 2.4788e-06
Epoch 41/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 1.6616e-06
Epoch 42/100
85/85 [==============================] - 2s 18ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 1.1138e-06
Epoch 43/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 7.4659e-07
Epoch 44/100
85/85 [==============================] - 2s 27ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 5.0045e-07
Epoch 45/100
85/85 [==============================] - 2s 22ms/step - loss: 0.0379 - val_loss: 0.0499 - lr: 3.3546e-07
Epoch 46/100
85/85 [==============================] - 2s 29ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 2.2487e-07
Epoch 47/100
85/85 [==============================] - 3s 31ms/step - loss: 0.0381 - val_loss: 0.0499 - lr: 1.5073e-07
Epoch 48/100
85/85 [==============================] - 2s 26ms/step - loss: 0.0383 - val_loss: 0.0499 - lr: 1.0104e-07
Epoch 49/100
85/85 [==============================] - 2s 24ms/step - loss: 0.0380 - val_loss: 0.0499 - lr: 6.7729e-08
Epoch 50/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0387 - val_loss: 0.0499 - lr: 4.5400e-08
Epoch 51/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0382 - val_loss: 0.0499 - lr: 2.7536e-08
Epoch 52/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0374 - val_loss: 0.0499 - lr: 1.6702e-08
Epoch 53/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 1.0130e-08
Epoch 54/100
85/85 [==============================] - 2s 25ms/step - loss: 0.0380 - val_loss: 0.0499 - lr: 6.1442e-09
Epoch 55/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0378 - val_loss: 0.0499 - lr: 3.7267e-09
Epoch 56/100
85/85 [==============================] - 2s 20ms/step - loss: 0.0388 - val_loss: 0.0499 - lr: 2.2603e-09
Epoch 57/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0384 - val_loss: 0.0499 - lr: 1.3710e-09
Epoch 58/100
85/85 [==============================] - 2s 21ms/step - loss: 0.0377 - val_loss: 0.0499 - lr: 8.3153e-10
Average Validation Loss: 0.06022659987211228
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 64
Epoch 1/100
9/9 [==============================] - 4s 153ms/step - loss: 0.1540 - val_loss: 0.1452 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 30ms/step - loss: 0.1234 - val_loss: 0.1525 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1227 - val_loss: 0.1320 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 31ms/step - loss: 0.1101 - val_loss: 0.1246 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 33ms/step - loss: 0.1013 - val_loss: 0.1269 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0989 - val_loss: 0.1219 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0886 - val_loss: 0.1191 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0784 - val_loss: 0.1105 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0676 - val_loss: 0.1127 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 26ms/step - loss: 0.0654 - val_loss: 0.1034 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0616 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0557 - val_loss: 0.1152 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0542 - val_loss: 0.1140 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0542 - val_loss: 0.1127 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0520 - val_loss: 0.1064 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0511 - val_loss: 0.1038 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 32ms/step - loss: 0.0505 - val_loss: 0.1139 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0541 - val_loss: 0.1007 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0493 - val_loss: 0.1162 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0526 - val_loss: 0.0986 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0491 - val_loss: 0.1127 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0479 - val_loss: 0.1014 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0492 - val_loss: 0.1099 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0502 - val_loss: 0.1053 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0489 - val_loss: 0.1016 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0484 - val_loss: 0.1043 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 34ms/step - loss: 0.0478 - val_loss: 0.1047 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 40ms/step - loss: 0.0477 - val_loss: 0.1042 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0483 - val_loss: 0.1032 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 1s 68ms/step - loss: 0.0476 - val_loss: 0.1035 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0493 - val_loss: 0.1029 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 51ms/step - loss: 0.0486 - val_loss: 0.1026 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 52ms/step - loss: 0.0483 - val_loss: 0.1031 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0475 - val_loss: 0.1037 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0472 - val_loss: 0.1037 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 43ms/step - loss: 0.0486 - val_loss: 0.1032 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0478 - val_loss: 0.1034 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 45ms/step - loss: 0.0488 - val_loss: 0.1033 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 50ms/step - loss: 0.0473 - val_loss: 0.1033 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 54ms/step - loss: 0.0481 - val_loss: 0.1033 - lr: 2.4788e-06
Epoch 1/100
17/17 [==============================] - 6s 76ms/step - loss: 0.1773 - val_loss: 0.0837 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 21ms/step - loss: 0.1280 - val_loss: 0.0817 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 18ms/step - loss: 0.1226 - val_loss: 0.0824 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 22ms/step - loss: 0.1156 - val_loss: 0.0852 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 17ms/step - loss: 0.1097 - val_loss: 0.0798 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 19ms/step - loss: 0.1043 - val_loss: 0.0831 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0939 - val_loss: 0.0853 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0933 - val_loss: 0.0852 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 16ms/step - loss: 0.0875 - val_loss: 0.0831 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0865 - val_loss: 0.0771 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0789 - val_loss: 0.0772 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0709 - val_loss: 0.0803 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0692 - val_loss: 0.0810 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0661 - val_loss: 0.0791 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0645 - val_loss: 0.0763 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0622 - val_loss: 0.0757 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0602 - val_loss: 0.0767 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 21ms/step - loss: 0.0589 - val_loss: 0.0753 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0578 - val_loss: 0.0727 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0590 - val_loss: 0.0791 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0573 - val_loss: 0.0784 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0586 - val_loss: 0.0728 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0563 - val_loss: 0.0772 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0536 - val_loss: 0.0752 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0551 - val_loss: 0.0767 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0547 - val_loss: 0.0759 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0549 - val_loss: 0.0772 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 17ms/step - loss: 0.0541 - val_loss: 0.0761 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0537 - val_loss: 0.0776 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0536 - val_loss: 0.0757 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0537 - val_loss: 0.0766 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 22ms/step - loss: 0.0521 - val_loss: 0.0777 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 24ms/step - loss: 0.0531 - val_loss: 0.0772 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0535 - val_loss: 0.0774 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 23ms/step - loss: 0.0541 - val_loss: 0.0770 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0535 - val_loss: 0.0766 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 18ms/step - loss: 0.0530 - val_loss: 0.0768 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 20ms/step - loss: 0.0536 - val_loss: 0.0768 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 19ms/step - loss: 0.0530 - val_loss: 0.0768 - lr: 3.3460e-06
Epoch 1/100
26/26 [==============================] - 7s 54ms/step - loss: 0.1287 - val_loss: 0.1207 - lr: 0.0010
Epoch 2/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1153 - val_loss: 0.1003 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 1s 22ms/step - loss: 0.1091 - val_loss: 0.0917 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 1s 23ms/step - loss: 0.1034 - val_loss: 0.0849 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0957 - val_loss: 0.0820 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0944 - val_loss: 0.0798 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0908 - val_loss: 0.0777 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0839 - val_loss: 0.0717 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0798 - val_loss: 0.0648 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0733 - val_loss: 0.0602 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0728 - val_loss: 0.0628 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0697 - val_loss: 0.0566 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 1s 27ms/step - loss: 0.0681 - val_loss: 0.0610 - lr: 7.4082e-04

Epoch 14/100
26/26 [==============================] - 1s 32ms/step - loss: 0.0696 - val_loss: 0.0589 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 1s 33ms/step - loss: 0.0722 - val_loss: 0.0586 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 1s 37ms/step - loss: 0.0762 - val_loss: 0.0577 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 1s 26ms/step - loss: 0.0708 - val_loss: 0.0603 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0672 - val_loss: 0.0615 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0629 - val_loss: 0.0588 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0611 - val_loss: 0.0590 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0596 - val_loss: 0.0588 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0572 - val_loss: 0.0599 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 1s 23ms/step - loss: 0.0565 - val_loss: 0.0591 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0552 - val_loss: 0.0600 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 1s 24ms/step - loss: 0.0546 - val_loss: 0.0596 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 1s 25ms/step - loss: 0.0541 - val_loss: 0.0580 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0540 - val_loss: 0.0577 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0530 - val_loss: 0.0588 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0526 - val_loss: 0.0591 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 1s 22ms/step - loss: 0.0525 - val_loss: 0.0582 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 1s 21ms/step - loss: 0.0523 - val_loss: 0.0581 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 1s 20ms/step - loss: 0.0529 - val_loss: 0.0574 - lr: 2.7324e-05
Epoch 1/100
34/34 [==============================] - 5s 46ms/step - loss: 0.1254 - val_loss: 0.1225 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 1s 27ms/step - loss: 0.1108 - val_loss: 0.1145 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0993 - val_loss: 0.0970 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0951 - val_loss: 0.0846 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0891 - val_loss: 0.0862 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0827 - val_loss: 0.0742 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0734 - val_loss: 0.0717 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0709 - val_loss: 0.0694 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0671 - val_loss: 0.0691 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0714 - val_loss: 0.0704 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0664 - val_loss: 0.0671 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0650 - val_loss: 0.0592 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0572 - val_loss: 0.0582 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0590 - val_loss: 0.0553 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0554 - val_loss: 0.0524 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0555 - val_loss: 0.0523 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0531 - val_loss: 0.0505 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0527 - val_loss: 0.0508 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0513 - val_loss: 0.0480 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0488 - val_loss: 0.0470 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0495 - val_loss: 0.0475 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0477 - val_loss: 0.0472 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0475 - val_loss: 0.0473 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0478 - val_loss: 0.0545 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0492 - val_loss: 0.0506 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 39ms/step - loss: 0.0494 - val_loss: 0.0524 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0521 - val_loss: 0.0455 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0505 - val_loss: 0.0419 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0492 - val_loss: 0.0414 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0474 - val_loss: 0.0411 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0473 - val_loss: 0.0415 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 38ms/step - loss: 0.0462 - val_loss: 0.0415 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 2s 44ms/step - loss: 0.0458 - val_loss: 0.0414 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0454 - val_loss: 0.0410 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 41ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0448 - val_loss: 0.0411 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0455 - val_loss: 0.0412 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0442 - val_loss: 0.0411 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0450 - val_loss: 0.0411 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0453 - val_loss: 0.0411 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 1s 40ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0444 - val_loss: 0.0410 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0443 - val_loss: 0.0410 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 2s 46ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0456 - val_loss: 0.0410 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 1s 43ms/step - loss: 0.0456 - val_loss: 0.0410 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0446 - val_loss: 0.0410 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 1s 44ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 1s 36ms/step - loss: 0.0459 - val_loss: 0.0410 - lr: 2.7536e-08

Epoch 52/100
34/34 [==============================] - 1s 35ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 1s 37ms/step - loss: 0.0450 - val_loss: 0.0410 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 2s 50ms/step - loss: 0.0448 - val_loss: 0.0410 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 2s 52ms/step - loss: 0.0447 - val_loss: 0.0410 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 2s 49ms/step - loss: 0.0451 - val_loss: 0.0410 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 1s 42ms/step - loss: 0.0452 - val_loss: 0.0410 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 2s 47ms/step - loss: 0.0455 - val_loss: 0.0410 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0449 - val_loss: 0.0410 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0453 - val_loss: 0.0410 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 1s 34ms/step - loss: 0.0458 - val_loss: 0.0410 - lr: 5.0565e-11
Epoch 1/100
43/43 [==============================] - 15s 103ms/step - loss: 0.1310 - val_loss: 0.1131 - lr: 0.0010
Epoch 2/100
43/43 [==============================] - 2s 42ms/step - loss: 0.1066 - val_loss: 0.1019 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 2s 47ms/step - loss: 0.0970 - val_loss: 0.0966 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0898 - val_loss: 0.0948 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0843 - val_loss: 0.0903 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0770 - val_loss: 0.0877 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0712 - val_loss: 0.0841 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 2s 46ms/step - loss: 0.0761 - val_loss: 0.0830 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 2s 38ms/step - loss: 0.0677 - val_loss: 0.0807 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 2s 49ms/step - loss: 0.0653 - val_loss: 0.0798 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 2s 48ms/step - loss: 0.0688 - val_loss: 0.0779 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 2s 36ms/step - loss: 0.0640 - val_loss: 0.0770 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 2s 42ms/step - loss: 0.0643 - val_loss: 0.0746 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0633 - val_loss: 0.0756 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 1s 35ms/step - loss: 0.0588 - val_loss: 0.0769 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 1s 35ms/step - loss: 0.0566 - val_loss: 0.0763 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0543 - val_loss: 0.0752 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 2s 43ms/step - loss: 0.0528 - val_loss: 0.0735 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 2s 47ms/step - loss: 0.0522 - val_loss: 0.0727 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 1s 32ms/step - loss: 0.0496 - val_loss: 0.0706 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0491 - val_loss: 0.0707 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 1s 31ms/step - loss: 0.0488 - val_loss: 0.0689 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 2s 35ms/step - loss: 0.0484 - val_loss: 0.0692 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 2s 37ms/step - loss: 0.0466 - val_loss: 0.0680 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 1s 26ms/step - loss: 0.0464 - val_loss: 0.0668 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0467 - val_loss: 0.0671 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 1s 25ms/step - loss: 0.0461 - val_loss: 0.0664 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0466 - val_loss: 0.0660 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 1s 28ms/step - loss: 0.0459 - val_loss: 0.0653 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0454 - val_loss: 0.0644 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0452 - val_loss: 0.0636 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0448 - val_loss: 0.0632 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0445 - val_loss: 0.0629 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0627 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0449 - val_loss: 0.0627 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 1s 24ms/step - loss: 0.0437 - val_loss: 0.0626 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0448 - val_loss: 0.0625 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0436 - val_loss: 0.0625 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0446 - val_loss: 0.0625 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0444 - val_loss: 0.0625 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 1s 21ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0438 - val_loss: 0.0624 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0432 - val_loss: 0.0624 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0441 - val_loss: 0.0624 - lr: 2.7536e-08
Epoch 52/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0447 - val_loss: 0.0624 - lr: 1.6702e-08
Epoch 53/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 1.0130e-08
Epoch 54/100
43/43 [==============================] - 1s 23ms/step - loss: 0.0450 - val_loss: 0.0624 - lr: 6.1442e-09
Epoch 55/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 3.7267e-09
Epoch 56/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 2.2603e-09
Epoch 57/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0436 - val_loss: 0.0624 - lr: 1.3710e-09
Epoch 58/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 8.3153e-10

Epoch 59/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0445 - val_loss: 0.0624 - lr: 5.0435e-10
Epoch 60/100
43/43 [==============================] - 1s 20ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 3.0590e-10
Epoch 61/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 1.6788e-10
Epoch 62/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 9.2136e-11
Epoch 63/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 5.0565e-11
Epoch 64/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0440 - val_loss: 0.0624 - lr: 2.7751e-11
Epoch 65/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0439 - val_loss: 0.0624 - lr: 1.5230e-11
Epoch 66/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0432 - val_loss: 0.0624 - lr: 8.3584e-12
Epoch 67/100
43/43 [==============================] - 1s 22ms/step - loss: 0.0443 - val_loss: 0.0624 - lr: 4.5872e-12
Epoch 68/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0442 - val_loss: 0.0624 - lr: 2.5175e-12
Epoch 69/100
43/43 [==============================] - 1s 17ms/step - loss: 0.0444 - val_loss: 0.0624 - lr: 1.3816e-12
Epoch 70/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0624 - lr: 7.5826e-13
Epoch 71/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0446 - val_loss: 0.0624 - lr: 3.7654e-13
Epoch 72/100
43/43 [==============================] - 1s 18ms/step - loss: 0.0435 - val_loss: 0.0624 - lr: 1.8698e-13
Epoch 73/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0445 - val_loss: 0.0624 - lr: 9.2853e-14
Epoch 74/100
43/43 [==============================] - 1s 19ms/step - loss: 0.0451 - val_loss: 0.0624 - lr: 4.6110e-14
Average Validation Loss: 0.06625610888004303
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 0.0001, batch_size: 128
Epoch 1/100
5/5 [==============================] - 8s 284ms/step - loss: 0.2034 - val_loss: 0.1508 - lr: 0.0010
Epoch 2/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1242 - val_loss: 0.1455 - lr: 0.0010
Epoch 3/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1166 - val_loss: 0.1580 - lr: 0.0010
Epoch 4/100
5/5 [==============================] - 0s 40ms/step - loss: 0.1284 - val_loss: 0.1627 - lr: 0.0010
Epoch 5/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1277 - val_loss: 0.1578 - lr: 0.0010
Epoch 6/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1217 - val_loss: 0.1489 - lr: 0.0010
Epoch 7/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1158 - val_loss: 0.1401 - lr: 0.0010
Epoch 8/100
5/5 [==============================] - 0s 39ms/step - loss: 0.1131 - val_loss: 0.1357 - lr: 0.0010
Epoch 9/100
5/5 [==============================] - 0s 41ms/step - loss: 0.1091 - val_loss: 0.1353 - lr: 0.0010
Epoch 10/100
5/5 [==============================] - 0s 43ms/step - loss: 0.1051 - val_loss: 0.1351 - lr: 0.0010
Epoch 11/100
5/5 [==============================] - 0s 44ms/step - loss: 0.1002 - val_loss: 0.1355 - lr: 9.0484e-04
Epoch 12/100
5/5 [==============================] - 0s 46ms/step - loss: 0.0957 - val_loss: 0.1333 - lr: 8.1873e-04
Epoch 13/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0906 - val_loss: 0.1305 - lr: 7.4082e-04
Epoch 14/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0897 - val_loss: 0.1303 - lr: 6.7032e-04
Epoch 15/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0820 - val_loss: 0.1265 - lr: 6.0653e-04
Epoch 16/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0781 - val_loss: 0.1203 - lr: 5.4881e-04
Epoch 17/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0707 - val_loss: 0.1262 - lr: 4.9659e-04
Epoch 18/100
5/5 [==============================] - 0s 39ms/step - loss: 0.0703 - val_loss: 0.1249 - lr: 4.4933e-04
Epoch 19/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0694 - val_loss: 0.1224 - lr: 4.0657e-04
Epoch 20/100
5/5 [==============================] - 0s 41ms/step - loss: 0.0688 - val_loss: 0.1200 - lr: 3.6788e-04
Epoch 21/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0661 - val_loss: 0.1187 - lr: 3.0119e-04
Epoch 22/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0643 - val_loss: 0.1223 - lr: 2.4660e-04
Epoch 23/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0649 - val_loss: 0.1202 - lr: 2.0190e-04
Epoch 24/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0641 - val_loss: 0.1144 - lr: 1.6530e-04
Epoch 25/100
5/5 [==============================] - 0s 52ms/step - loss: 0.0619 - val_loss: 0.1157 - lr: 1.3534e-04
Epoch 26/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0631 - val_loss: 0.1187 - lr: 1.1080e-04
Epoch 27/100
5/5 [==============================] - 0s 47ms/step - loss: 0.0628 - val_loss: 0.1202 - lr: 9.0718e-05
Epoch 28/100
5/5 [==============================] - 0s 45ms/step - loss: 0.0635 - val_loss: 0.1211 - lr: 7.4274e-05
Epoch 29/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0610 - val_loss: 0.1218 - lr: 6.0810e-05
Epoch 30/100
5/5 [==============================] - 0s 43ms/step - loss: 0.0603 - val_loss: 0.1209 - lr: 4.9787e-05
Epoch 31/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0588 - val_loss: 0.1197 - lr: 3.6883e-05
Epoch 32/100
5/5 [==============================] - 0s 44ms/step - loss: 0.0597 - val_loss: 0.1197 - lr: 2.7324e-05
Epoch 33/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0581 - val_loss: 0.1201 - lr: 2.0242e-05
Epoch 34/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0597 - val_loss: 0.1202 - lr: 1.4996e-05
Epoch 35/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0593 - val_loss: 0.1201 - lr: 1.1109e-05
Epoch 36/100
5/5 [==============================] - 0s 37ms/step - loss: 0.0622 - val_loss: 0.1200 - lr: 8.2297e-06
Epoch 37/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0602 - val_loss: 0.1199 - lr: 6.0967e-06
Epoch 38/100
5/5 [==============================] - 0s 42ms/step - loss: 0.0609 - val_loss: 0.1198 - lr: 4.5166e-06
Epoch 39/100
5/5 [==============================] - 0s 40ms/step - loss: 0.0617 - val_loss: 0.1198 - lr: 3.3460e-06
Epoch 40/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0576 - val_loss: 0.1197 - lr: 2.4788e-06
Epoch 41/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0612 - val_loss: 0.1197 - lr: 1.6616e-06
Epoch 42/100
5/5 [==============================] - 0s 35ms/step - loss: 0.0591 - val_loss: 0.1196 - lr: 1.1138e-06
Epoch 43/100
5/5 [==============================] - 0s 36ms/step - loss: 0.0607 - val_loss: 0.1196 - lr: 7.4659e-07
Epoch 44/100
5/5 [==============================] - 0s 38ms/step - loss: 0.0593 - val_loss: 0.1195 - lr: 5.0045e-07
Epoch 1/100
9/9 [==============================] - 4s 122ms/step - loss: 0.1731 - val_loss: 0.0990 - lr: 0.0010
Epoch 2/100
9/9 [==============================] - 0s 25ms/step - loss: 0.1354 - val_loss: 0.0891 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 27ms/step - loss: 0.1240 - val_loss: 0.0881 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1165 - val_loss: 0.0759 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 29ms/step - loss: 0.1088 - val_loss: 0.0827 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0999 - val_loss: 0.0834 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 28ms/step - loss: 0.1001 - val_loss: 0.0775 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0911 - val_loss: 0.0854 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0882 - val_loss: 0.0840 - lr: 0.0010
Epoch 10/100

9/9 [==============================] - 0s 28ms/step - loss: 0.0850 - val_loss: 0.0820 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0799 - val_loss: 0.0869 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0784 - val_loss: 0.0792 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 38ms/step - loss: 0.0758 - val_loss: 0.0799 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0745 - val_loss: 0.0750 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0699 - val_loss: 0.0774 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0696 - val_loss: 0.0828 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 37ms/step - loss: 0.0687 - val_loss: 0.0683 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0681 - val_loss: 0.0704 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 27ms/step - loss: 0.0652 - val_loss: 0.0772 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 36ms/step - loss: 0.0663 - val_loss: 0.0661 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0641 - val_loss: 0.0691 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 31ms/step - loss: 0.0639 - val_loss: 0.0644 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0617 - val_loss: 0.0673 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0607 - val_loss: 0.0700 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0630 - val_loss: 0.0618 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0611 - val_loss: 0.0657 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0601 - val_loss: 0.0644 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0599 - val_loss: 0.0655 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0591 - val_loss: 0.0665 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 30ms/step - loss: 0.0599 - val_loss: 0.0637 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0585 - val_loss: 0.0638 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0603 - val_loss: 0.0637 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0597 - val_loss: 0.0633 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0588 - val_loss: 0.0638 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0592 - val_loss: 0.0641 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0598 - val_loss: 0.0641 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0586 - val_loss: 0.0643 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0595 - val_loss: 0.0642 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0595 - val_loss: 0.0643 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 29ms/step - loss: 0.0581 - val_loss: 0.0643 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0590 - val_loss: 0.0642 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0584 - val_loss: 0.0641 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0597 - val_loss: 0.0641 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0593 - val_loss: 0.0641 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 28ms/step - loss: 0.0602 - val_loss: 0.0641 - lr: 3.3546e-07
Epoch 1/100
13/13 [==============================] - 4s 86ms/step - loss: 0.1424 - val_loss: 0.1228 - lr: 0.0010
Epoch 2/100
13/13 [==============================] - 0s 24ms/step - loss: 0.1165 - val_loss: 0.1189 - lr: 0.0010
Epoch 3/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1063 - val_loss: 0.1006 - lr: 0.0010
Epoch 4/100
13/13 [==============================] - 0s 25ms/step - loss: 0.1012 - val_loss: 0.0853 - lr: 0.0010
Epoch 5/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0973 - val_loss: 0.0793 - lr: 0.0010
Epoch 6/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0927 - val_loss: 0.0783 - lr: 0.0010
Epoch 7/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0866 - val_loss: 0.0716 - lr: 0.0010
Epoch 8/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0811 - val_loss: 0.0699 - lr: 0.0010
Epoch 9/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0804 - val_loss: 0.0704 - lr: 0.0010
Epoch 10/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0870 - val_loss: 0.0723 - lr: 0.0010
Epoch 11/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0771 - val_loss: 0.0715 - lr: 9.0484e-04
Epoch 12/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0710 - val_loss: 0.0620 - lr: 8.1873e-04
Epoch 13/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0669 - val_loss: 0.0601 - lr: 7.4082e-04
Epoch 14/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0661 - val_loss: 0.0596 - lr: 6.7032e-04
Epoch 15/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0710 - val_loss: 0.0577 - lr: 6.0653e-04
Epoch 16/100
13/13 [==============================] - 0s 25ms/step - loss: 0.0711 - val_loss: 0.0693 - lr: 5.4881e-04
Epoch 17/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0653 - val_loss: 0.0700 - lr: 4.9659e-04
Epoch 18/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0590 - val_loss: 0.0581 - lr: 4.4933e-04
Epoch 19/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0593 - val_loss: 0.0555 - lr: 4.0657e-04
Epoch 20/100
13/13 [==============================] - 0s 33ms/step - loss: 0.0576 - val_loss: 0.0576 - lr: 3.6788e-04
Epoch 21/100
13/13 [==============================] - 0s 34ms/step - loss: 0.0561 - val_loss: 0.0550 - lr: 3.0119e-04
Epoch 22/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0568 - val_loss: 0.0576 - lr: 2.4660e-04
Epoch 23/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0553 - val_loss: 0.0623 - lr: 2.0190e-04
Epoch 24/100
13/13 [==============================] - 0s 32ms/step - loss: 0.0525 - val_loss: 0.0554 - lr: 1.6530e-04
Epoch 25/100
13/13 [==============================] - 0s 27ms/step - loss: 0.0543 - val_loss: 0.0601 - lr: 1.3534e-04
Epoch 26/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0536 - val_loss: 0.0580 - lr: 1.1080e-04
Epoch 27/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0526 - val_loss: 0.0577 - lr: 9.0718e-05
Epoch 28/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0539 - val_loss: 0.0561 - lr: 7.4274e-05
Epoch 29/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0541 - val_loss: 0.0569 - lr: 6.0810e-05
Epoch 30/100
13/13 [==============================] - 0s 37ms/step - loss: 0.0525 - val_loss: 0.0564 - lr: 4.9787e-05
Epoch 31/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0570 - lr: 3.6883e-05
Epoch 32/100
13/13 [==============================] - 0s 30ms/step - loss: 0.0528 - val_loss: 0.0577 - lr: 2.7324e-05
Epoch 33/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0532 - val_loss: 0.0573 - lr: 2.0242e-05
Epoch 34/100
13/13 [==============================] - 0s 31ms/step - loss: 0.0525 - val_loss: 0.0576 - lr: 1.4996e-05
Epoch 35/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0528 - val_loss: 0.0574 - lr: 1.1109e-05
Epoch 36/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0524 - val_loss: 0.0574 - lr: 8.2297e-06
Epoch 37/100
13/13 [==============================] - 0s 26ms/step - loss: 0.0537 - val_loss: 0.0576 - lr: 6.0967e-06
Epoch 38/100
13/13 [==============================] - 0s 35ms/step - loss: 0.0533 - val_loss: 0.0578 - lr: 4.5166e-06
Epoch 39/100
13/13 [==============================] - 0s 29ms/step - loss: 0.0528 - val_loss: 0.0578 - lr: 3.3460e-06
Epoch 40/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0534 - val_loss: 0.0577 - lr: 2.4788e-06
Epoch 41/100
13/13 [==============================] - 0s 28ms/step - loss: 0.0539 - val_loss: 0.0576 - lr: 1.6616e-06
Epoch 1/100
17/17 [==============================] - 6s 126ms/step - loss: 0.1394 - val_loss: 0.1226 - lr: 0.0010
Epoch 2/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1191 - val_loss: 0.1143 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 27ms/step - loss: 0.1061 - val_loss: 0.1168 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1016 - val_loss: 0.1359 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1038 - val_loss: 0.1322 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 26ms/step - loss: 0.1052 - val_loss: 0.0944 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0894 - val_loss: 0.1014 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0848 - val_loss: 0.1175 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0833 - val_loss: 0.1148 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0823 - val_loss: 0.1214 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0909 - val_loss: 0.1081 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0907 - val_loss: 0.0669 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0697 - val_loss: 0.0646 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0656 - val_loss: 0.0780 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 1s 45ms/step - loss: 0.0638 - val_loss: 0.0752 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 1s 38ms/step - loss: 0.0639 - val_loss: 0.0797 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0648 - val_loss: 0.0702 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0645 - val_loss: 0.0674 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0654 - val_loss: 0.0565 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0621 - val_loss: 0.0456 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0582 - val_loss: 0.0412 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0559 - val_loss: 0.0422 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0529 - val_loss: 0.0402 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0527 - val_loss: 0.0393 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 29ms/step - loss: 0.0529 - val_loss: 0.0392 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0518 - val_loss: 0.0396 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0527 - val_loss: 0.0393 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0521 - val_loss: 0.0390 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0510 - val_loss: 0.0390 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0506 - val_loss: 0.0390 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0388 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0503 - val_loss: 0.0387 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0511 - val_loss: 0.0388 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0505 - val_loss: 0.0388 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0518 - val_loss: 0.0387 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0511 - val_loss: 0.0386 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 25ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0507 - val_loss: 0.0386 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 27ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 26ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 6.7729e-08
Epoch 50/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0503 - val_loss: 0.0386 - lr: 4.5400e-08
Epoch 51/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 2.7536e-08
Epoch 52/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0513 - val_loss: 0.0386 - lr: 1.6702e-08
Epoch 53/100
17/17 [==============================] - 1s 41ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 1.0130e-08
Epoch 54/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 6.1442e-09
Epoch 55/100
17/17 [==============================] - 1s 35ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 3.7267e-09
Epoch 56/100
17/17 [==============================] - 1s 32ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 2.2603e-09
Epoch 57/100
17/17 [==============================] - 1s 31ms/step - loss: 0.0514 - val_loss: 0.0386 - lr: 1.3710e-09
Epoch 58/100
17/17 [==============================] - 0s 28ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 8.3153e-10
Epoch 59/100
17/17 [==============================] - 1s 33ms/step - loss: 0.0501 - val_loss: 0.0386 - lr: 5.0435e-10
Epoch 60/100
17/17 [==============================] - 1s 37ms/step - loss: 0.0512 - val_loss: 0.0386 - lr: 3.0590e-10
Epoch 61/100
17/17 [==============================] - 1s 36ms/step - loss: 0.0500 - val_loss: 0.0386 - lr: 1.6788e-10
Epoch 62/100
17/17 [==============================] - 0s 30ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 9.2136e-11
Epoch 63/100
17/17 [==============================] - 1s 34ms/step - loss: 0.0504 - val_loss: 0.0386 - lr: 5.0565e-11

Epoch 64/100
17/17 [==============================] - 1s 80ms/step - loss: 0.0507 - val_loss: 0.0386 - lr: 2.7751e-11
Epoch 65/100
17/17 [==============================] - 1s 69ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 1.5230e-11
Epoch 66/100
17/17 [==============================] - 2s 89ms/step - loss: 0.0506 - val_loss: 0.0386 - lr: 8.3584e-12
Epoch 67/100
17/17 [==============================] - 2s 141ms/step - loss: 0.0511 - val_loss: 0.0386 - lr: 4.5872e-12
Epoch 68/100
17/17 [==============================] - 2s 125ms/step - loss: 0.0516 - val_loss: 0.0386 - lr: 2.5175e-12
Epoch 69/100
17/17 [==============================] - 2s 118ms/step - loss: 0.0499 - val_loss: 0.0386 - lr: 1.3816e-12
Epoch 70/100
17/17 [==============================] - 2s 102ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 7.5826e-13
Epoch 71/100
17/17 [==============================] - 1s 71ms/step - loss: 0.0505 - val_loss: 0.0386 - lr: 3.7654e-13
Epoch 72/100
17/17 [==============================] - 1s 71ms/step - loss: 0.0510 - val_loss: 0.0386 - lr: 1.8698e-13
Epoch 73/100
17/17 [==============================] - 1s 59ms/step - loss: 0.0508 - val_loss: 0.0386 - lr: 9.2853e-14
Epoch 74/100
17/17 [==============================] - 1s 72ms/step - loss: 0.0509 - val_loss: 0.0386 - lr: 4.6110e-14
Epoch 1/100
22/22 [==============================] - 5s 69ms/step - loss: 0.1646 - val_loss: 0.1242 - lr: 0.0010
Epoch 2/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1304 - val_loss: 0.1161 - lr: 0.0010
Epoch 3/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1114 - val_loss: 0.1132 - lr: 0.0010
Epoch 4/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1081 - val_loss: 0.1113 - lr: 0.0010
Epoch 5/100
22/22 [==============================] - 1s 27ms/step - loss: 0.1081 - val_loss: 0.1136 - lr: 0.0010
Epoch 6/100
22/22 [==============================] - 1s 28ms/step - loss: 0.1049 - val_loss: 0.1085 - lr: 0.0010
Epoch 7/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0988 - val_loss: 0.1063 - lr: 0.0010
Epoch 8/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0974 - val_loss: 0.1076 - lr: 0.0010
Epoch 9/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0966 - val_loss: 0.1046 - lr: 0.0010
Epoch 10/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0924 - val_loss: 0.1033 - lr: 0.0010
Epoch 11/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0897 - val_loss: 0.1025 - lr: 9.0484e-04
Epoch 12/100
22/22 [==============================] - 1s 36ms/step - loss: 0.0848 - val_loss: 0.1002 - lr: 8.1873e-04
Epoch 13/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0826 - val_loss: 0.0992 - lr: 7.4082e-04
Epoch 14/100
22/22 [==============================] - 1s 37ms/step - loss: 0.0784 - val_loss: 0.0974 - lr: 6.7032e-04
Epoch 15/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0766 - val_loss: 0.0961 - lr: 6.0653e-04
Epoch 16/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0724 - val_loss: 0.0931 - lr: 5.4881e-04
Epoch 17/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0699 - val_loss: 0.0924 - lr: 4.9659e-04
Epoch 18/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0681 - val_loss: 0.0907 - lr: 4.4933e-04
Epoch 19/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0669 - val_loss: 0.0876 - lr: 4.0657e-04
Epoch 20/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0644 - val_loss: 0.0847 - lr: 3.6788e-04
Epoch 21/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0614 - val_loss: 0.0798 - lr: 3.0119e-04
Epoch 22/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0586 - val_loss: 0.0752 - lr: 2.4660e-04
Epoch 23/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0561 - val_loss: 0.0708 - lr: 2.0190e-04
Epoch 24/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0537 - val_loss: 0.0690 - lr: 1.6530e-04
Epoch 25/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0521 - val_loss: 0.0680 - lr: 1.3534e-04
Epoch 26/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0529 - val_loss: 0.0677 - lr: 1.1080e-04
Epoch 27/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0666 - lr: 9.0718e-05
Epoch 28/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0524 - val_loss: 0.0662 - lr: 7.4274e-05
Epoch 29/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0514 - val_loss: 0.0659 - lr: 6.0810e-05
Epoch 30/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0517 - val_loss: 0.0655 - lr: 4.9787e-05
Epoch 31/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0513 - val_loss: 0.0654 - lr: 3.6883e-05
Epoch 32/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0655 - lr: 2.7324e-05
Epoch 33/100
22/22 [==============================] - 1s 42ms/step - loss: 0.0508 - val_loss: 0.0655 - lr: 2.0242e-05
Epoch 34/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0515 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0511 - val_loss: 0.0654 - lr: 1.1109e-05
Epoch 36/100
22/22 [==============================] - 1s 33ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 8.2297e-06
Epoch 37/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 6.0967e-06
Epoch 38/100
22/22 [==============================] - 1s 34ms/step - loss: 0.0507 - val_loss: 0.0653 - lr: 4.5166e-06
Epoch 39/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0505 - val_loss: 0.0653 - lr: 3.3460e-06
Epoch 40/100
22/22 [==============================] - 1s 29ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 2.4788e-06
Epoch 41/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0514 - val_loss: 0.0653 - lr: 1.6616e-06
Epoch 42/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0513 - val_loss: 0.0653 - lr: 1.1138e-06
Epoch 43/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 7.4659e-07
Epoch 44/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0506 - val_loss: 0.0653 - lr: 5.0045e-07
Epoch 45/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0509 - val_loss: 0.0653 - lr: 3.3546e-07
Epoch 46/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 2.2487e-07
Epoch 47/100
22/22 [==============================] - 1s 28ms/step - loss: 0.0507 - val_loss: 0.0653 - lr: 1.5073e-07
Epoch 48/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 1.0104e-07
Epoch 49/100
22/22 [==============================] - 1s 30ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 6.7729e-08
Epoch 50/100
22/22 [==============================] - 1s 39ms/step - loss: 0.0498 - val_loss: 0.0653 - lr: 4.5400e-08
Epoch 51/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 2.7536e-08
Epoch 52/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 1.6702e-08
Epoch 53/100
22/22 [==============================] - 1s 32ms/step - loss: 0.0502 - val_loss: 0.0653 - lr: 1.0130e-08
Epoch 54/100
22/22 [==============================] - 1s 27ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 6.1442e-09
Epoch 55/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0504 - val_loss: 0.0653 - lr: 3.7267e-09
Epoch 56/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 2.2603e-09
Epoch 57/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0511 - val_loss: 0.0653 - lr: 1.3710e-09
Epoch 58/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0510 - val_loss: 0.0653 - lr: 8.3153e-10
Epoch 59/100
22/22 [==============================] - 1s 25ms/step - loss: 0.0500 - val_loss: 0.0653 - lr: 5.0435e-10

Epoch 60/100
22/22 [==============================] - 1s 26ms/step - loss: 0.0508 - val_loss: 0.0653 - lr: 3.0590e-10
Average Validation Loss: 0.06702316775918007
Current Best Configuration: {'neurons': 16, 'dropout': 0.3, 'l1_reg': 1e-05, 'l2_reg': 1e-05, 'batch_size': 32}
Training with neurons: 32, dropout: 0.3, l1_reg: 1e-05, l2_reg: 1e-05, batch_size: 32
Epoch 1/100
18/18 [==============================] - 4s 71ms/step - loss: 0.1004 - val_loss: 0.1655 - lr: 0.0010
Epoch 2/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1237 - val_loss: 0.1229 - lr: 0.0010
Epoch 3/100
18/18 [==============================] - 0s 19ms/step - loss: 0.1076 - val_loss: 0.1147 - lr: 0.0010
Epoch 4/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0953 - val_loss: 0.1143 - lr: 0.0010
Epoch 5/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0869 - val_loss: 0.1189 - lr: 0.0010
Epoch 6/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0672 - val_loss: 0.1385 - lr: 0.0010
Epoch 7/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0720 - val_loss: 0.1102 - lr: 0.0010
Epoch 8/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0559 - val_loss: 0.1020 - lr: 0.0010
Epoch 9/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0551 - val_loss: 0.1061 - lr: 0.0010
Epoch 10/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0563 - val_loss: 0.1051 - lr: 0.0010
Epoch 11/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0624 - val_loss: 0.0976 - lr: 9.0484e-04
Epoch 12/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0632 - val_loss: 0.1131 - lr: 8.1873e-04
Epoch 13/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0603 - val_loss: 0.1033 - lr: 7.4082e-04
Epoch 14/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0474 - val_loss: 0.0929 - lr: 6.7032e-04
Epoch 15/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0493 - val_loss: 0.0995 - lr: 6.0653e-04
Epoch 16/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0439 - val_loss: 0.1053 - lr: 5.4881e-04
Epoch 17/100
18/18 [==============================] - 1s 32ms/step - loss: 0.0424 - val_loss: 0.1026 - lr: 4.9659e-04
Epoch 18/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0422 - val_loss: 0.0954 - lr: 4.4933e-04
Epoch 19/100
18/18 [==============================] - 1s 40ms/step - loss: 0.0420 - val_loss: 0.0992 - lr: 4.0657e-04
Epoch 20/100
18/18 [==============================] - 1s 33ms/step - loss: 0.0415 - val_loss: 0.0927 - lr: 3.6788e-04
Epoch 21/100
18/18 [==============================] - 0s 27ms/step - loss: 0.0385 - val_loss: 0.0993 - lr: 3.0119e-04
Epoch 22/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0408 - val_loss: 0.0977 - lr: 2.4660e-04
Epoch 23/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0400 - val_loss: 0.0923 - lr: 2.0190e-04
Epoch 24/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0401 - val_loss: 0.0964 - lr: 1.6530e-04
Epoch 25/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0372 - val_loss: 0.0972 - lr: 1.3534e-04
Epoch 26/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0372 - val_loss: 0.0932 - lr: 1.1080e-04
Epoch 27/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0366 - val_loss: 0.0961 - lr: 9.0718e-05
Epoch 28/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0393 - val_loss: 0.0938 - lr: 7.4274e-05
Epoch 29/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0369 - val_loss: 0.0959 - lr: 6.0810e-05
Epoch 30/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0384 - val_loss: 0.0953 - lr: 4.9787e-05
Epoch 31/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0395 - val_loss: 0.0923 - lr: 3.6883e-05
Epoch 32/100
18/18 [==============================] - 1s 44ms/step - loss: 0.0380 - val_loss: 0.0926 - lr: 2.7324e-05
Epoch 33/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0376 - val_loss: 0.0933 - lr: 2.0242e-05
Epoch 34/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0384 - val_loss: 0.0938 - lr: 1.4996e-05
Epoch 35/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0370 - val_loss: 0.0941 - lr: 1.1109e-05
Epoch 36/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0376 - val_loss: 0.0941 - lr: 8.2297e-06
Epoch 37/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0388 - val_loss: 0.0940 - lr: 6.0967e-06
Epoch 38/100
18/18 [==============================] - 0s 23ms/step - loss: 0.0374 - val_loss: 0.0936 - lr: 4.5166e-06
Epoch 39/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0387 - val_loss: 0.0933 - lr: 3.3460e-06
Epoch 40/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0375 - val_loss: 0.0934 - lr: 2.4788e-06
Epoch 41/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0372 - val_loss: 0.0934 - lr: 1.6616e-06
Epoch 42/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0373 - val_loss: 0.0935 - lr: 1.1138e-06
Epoch 43/100
18/18 [==============================] - 0s 25ms/step - loss: 0.0376 - val_loss: 0.0935 - lr: 7.4659e-07
Epoch 44/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0380 - val_loss: 0.0936 - lr: 5.0045e-07
Epoch 45/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0373 - val_loss: 0.0936 - lr: 3.3546e-07
Epoch 46/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0382 - val_loss: 0.0936 - lr: 2.2487e-07
Epoch 47/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0936 - lr: 1.5073e-07
Epoch 48/100
18/18 [==============================] - 0s 22ms/step - loss: 0.0381 - val_loss: 0.0936 - lr: 1.0104e-07
Epoch 49/100
18/18 [==============================] - 0s 20ms/step - loss: 0.0385 - val_loss: 0.0936 - lr: 6.7729e-08
Epoch 50/100
18/18 [==============================] - 0s 19ms/step - loss: 0.0375 - val_loss: 0.0936 - lr: 4.5400e-08
Epoch 51/100
18/18 [==============================] - 0s 21ms/step - loss: 0.0371 - val_loss: 0.0936 - lr: 2.7536e-08
Epoch 1/100
34/34 [==============================] - 4s 39ms/step - loss: 0.1407 - val_loss: 0.0842 - lr: 0.0010
Epoch 2/100
34/34 [==============================] - 0s 13ms/step - loss: 0.1275 - val_loss: 0.0795 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 14ms/step - loss: 0.1171 - val_loss: 0.0760 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 1s 16ms/step - loss: 0.1189 - val_loss: 0.0724 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 1s 17ms/step - loss: 0.1146 - val_loss: 0.0791 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 1s 23ms/step - loss: 0.1123 - val_loss: 0.0649 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 1s 29ms/step - loss: 0.1042 - val_loss: 0.0859 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 1s 19ms/step - loss: 0.1040 - val_loss: 0.0594 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 1s 22ms/step - loss: 0.1043 - val_loss: 0.0777 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0989 - val_loss: 0.0629 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 1s 16ms/step - loss: 0.0944 - val_loss: 0.0838 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 1s 17ms/step - loss: 0.0875 - val_loss: 0.0697 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 2s 45ms/step - loss: 0.0833 - val_loss: 0.0786 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0785 - val_loss: 0.0741 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0756 - val_loss: 0.0766 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 1s 29ms/step - loss: 0.0700 - val_loss: 0.0695 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0691 - val_loss: 0.0629 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0655 - val_loss: 0.0573 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0633 - val_loss: 0.0589 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 1s 33ms/step - loss: 0.0577 - val_loss: 0.0614 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0529 - val_loss: 0.0583 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 1s 27ms/step - loss: 0.0514 - val_loss: 0.0620 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0491 - val_loss: 0.0636 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 1s 26ms/step - loss: 0.0484 - val_loss: 0.0673 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0469 - val_loss: 0.0651 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0470 - val_loss: 0.0639 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0468 - val_loss: 0.0640 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 1s 22ms/step - loss: 0.0453 - val_loss: 0.0660 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 1s 21ms/step - loss: 0.0454 - val_loss: 0.0666 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0455 - val_loss: 0.0653 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 1s 24ms/step - loss: 0.0457 - val_loss: 0.0655 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0451 - val_loss: 0.0660 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 1s 28ms/step - loss: 0.0443 - val_loss: 0.0652 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0443 - val_loss: 0.0656 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 1s 30ms/step - loss: 0.0446 - val_loss: 0.0668 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 1s 32ms/step - loss: 0.0443 - val_loss: 0.0667 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 1s 31ms/step - loss: 0.0443 - val_loss: 0.0661 - lr: 6.0967e-06
Epoch 38/100
 5/34 [===>..........................] - ETA: 0s - loss: 0.0299

KeyboardInterrupt: 

Code

# Generate predictions
train_pred = model_final.predict(X_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model_final.predict(X_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')

# Ensure the index is constructed correctly 
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()

102/102 [==============================] - 0s 798us/step
34/34 [==============================] - 0s 825us/step

Code

# Initialize a list to store RMSEs for each fold
cv_rmses = []

# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define and compile the LSTM model
    model = build_model(input_shape, output_units=1, neurons=best_config['neurons'], dropout=best_config['dropout'], l1_reg=best_config['l1_reg'], l2_reg=best_config['l2_reg'])
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=best_config['batch_size'], validation_data=(X_val_fold, y_val_fold), shuffle=False, callbacks=[lr_schedule, early_stopping])

    # Make predictions on the validation fold and calculate RMSE
    val_pred = model.predict(X_val_fold).flatten()
    val_rmse = np.sqrt(mean_squared_error(y_val_fold, val_pred))
    cv_rmses.append(val_rmse)

# Calculate the average cross-validated RMSE
cv_rmse = np.mean(cv_rmses)
print(f"Cross-validated RMSE: {cv_rmse}")

Epoch 1/100

2023-11-27 18:44:23.070813: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.071478: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.071842: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:23.128295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.128674: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.129049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:23.214412: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.214921: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.215395: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:23.276177: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.276700: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.277302: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:23.532479: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.532966: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.533398: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:23.596090: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:23.596560: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:23.597041: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 1s 39ms/step - loss: 0.1281 - val_loss: 0.1464 - lr: 0.0010
Epoch 2/100
1/9 [==>...........................] - ETA: 0s - loss: 0.0874

2023-11-27 18:44:24.212677: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:24.213311: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:24.214004: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:24.278899: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:24.279316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:24.279662: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

9/9 [==============================] - 0s 7ms/step - loss: 0.1217 - val_loss: 0.1608 - lr: 0.0010
Epoch 3/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1197 - val_loss: 0.1322 - lr: 0.0010
Epoch 4/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1108 - val_loss: 0.1200 - lr: 0.0010
Epoch 5/100
9/9 [==============================] - 0s 6ms/step - loss: 0.1019 - val_loss: 0.1214 - lr: 0.0010
Epoch 6/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0941 - val_loss: 0.1247 - lr: 0.0010
Epoch 7/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0967 - val_loss: 0.1204 - lr: 0.0010
Epoch 8/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0867 - val_loss: 0.1142 - lr: 0.0010
Epoch 9/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0762 - val_loss: 0.1100 - lr: 0.0010
Epoch 10/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0684 - val_loss: 0.1031 - lr: 0.0010
Epoch 11/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0589 - val_loss: 0.0999 - lr: 9.0484e-04
Epoch 12/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0552 - val_loss: 0.0948 - lr: 8.1873e-04
Epoch 13/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0523 - val_loss: 0.1112 - lr: 7.4082e-04
Epoch 14/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0549 - val_loss: 0.0972 - lr: 6.7032e-04
Epoch 15/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0468 - val_loss: 0.0976 - lr: 6.0653e-04
Epoch 16/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0454 - val_loss: 0.0981 - lr: 5.4881e-04
Epoch 17/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0469 - val_loss: 0.0966 - lr: 4.9659e-04
Epoch 18/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0455 - val_loss: 0.0989 - lr: 4.4933e-04
Epoch 19/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0466 - val_loss: 0.0950 - lr: 4.0657e-04
Epoch 20/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0445 - val_loss: 0.1000 - lr: 3.6788e-04
Epoch 21/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0447 - val_loss: 0.0953 - lr: 3.0119e-04
Epoch 22/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0445 - val_loss: 0.0994 - lr: 2.4660e-04
Epoch 23/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0441 - val_loss: 0.0941 - lr: 2.0190e-04
Epoch 24/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0436 - val_loss: 0.0946 - lr: 1.6530e-04
Epoch 25/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0436 - val_loss: 0.0970 - lr: 1.3534e-04
Epoch 26/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0423 - val_loss: 0.0949 - lr: 1.1080e-04
Epoch 27/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0449 - val_loss: 0.0954 - lr: 9.0718e-05
Epoch 28/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0422 - val_loss: 0.0967 - lr: 7.4274e-05
Epoch 29/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0445 - val_loss: 0.0948 - lr: 6.0810e-05
Epoch 30/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0443 - val_loss: 0.0931 - lr: 4.9787e-05
Epoch 31/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0424 - val_loss: 0.0937 - lr: 3.6883e-05
Epoch 32/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0432 - val_loss: 0.0952 - lr: 2.7324e-05
Epoch 33/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0454 - val_loss: 0.0949 - lr: 2.0242e-05
Epoch 34/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0416 - val_loss: 0.0947 - lr: 1.4996e-05
Epoch 35/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0430 - val_loss: 0.0948 - lr: 1.1109e-05
Epoch 36/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0440 - val_loss: 0.0948 - lr: 8.2297e-06
Epoch 37/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0431 - val_loss: 0.0946 - lr: 6.0967e-06
Epoch 38/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0438 - val_loss: 0.0946 - lr: 4.5166e-06
Epoch 39/100
9/9 [==============================] - 0s 8ms/step - loss: 0.0435 - val_loss: 0.0946 - lr: 3.3460e-06
Epoch 40/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0408 - val_loss: 0.0946 - lr: 2.4788e-06
Epoch 41/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0413 - val_loss: 0.0946 - lr: 1.6616e-06
Epoch 42/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0426 - val_loss: 0.0946 - lr: 1.1138e-06
Epoch 43/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0428 - val_loss: 0.0946 - lr: 7.4659e-07
Epoch 44/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0433 - val_loss: 0.0946 - lr: 5.0045e-07
Epoch 45/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0430 - val_loss: 0.0946 - lr: 3.3546e-07
Epoch 46/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0426 - val_loss: 0.0946 - lr: 2.2487e-07
Epoch 47/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0433 - val_loss: 0.0946 - lr: 1.5073e-07
Epoch 48/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0442 - val_loss: 0.0946 - lr: 1.0104e-07
Epoch 49/100
9/9 [==============================] - 0s 6ms/step - loss: 0.0427 - val_loss: 0.0946 - lr: 6.7729e-08
Epoch 50/100
9/9 [==============================] - 0s 7ms/step - loss: 0.0411 - val_loss: 0.0946 - lr: 4.5400e-08

2023-11-27 18:44:27.279078: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:27.279623: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:27.280015: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 1ms/step

2023-11-27 18:44:27.905968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:27.906491: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:27.906868: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:28.061339: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.061684: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.062420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Epoch 1/100

2023-11-27 18:44:28.123133: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.123648: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.124249: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:28.208375: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.208853: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.209182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:28.268895: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.269416: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.269865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:28.465001: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.465513: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.466105: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:28.524340: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:28.524801: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:28.525139: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 1s 19ms/step - loss: 0.1420 - val_loss: 0.0739 - lr: 0.0010
Epoch 2/100
 1/17 [>.............................] - ETA: 0s - loss: 0.0858

2023-11-27 18:44:29.004547: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:29.005016: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:29.005694: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:29.067296: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:29.067738: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:29.068120: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

17/17 [==============================] - 0s 5ms/step - loss: 0.1268 - val_loss: 0.0905 - lr: 0.0010
Epoch 3/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1130 - val_loss: 0.0669 - lr: 0.0010
Epoch 4/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1070 - val_loss: 0.0775 - lr: 0.0010
Epoch 5/100
17/17 [==============================] - 0s 5ms/step - loss: 0.1041 - val_loss: 0.0668 - lr: 0.0010
Epoch 6/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0991 - val_loss: 0.0696 - lr: 0.0010
Epoch 7/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0922 - val_loss: 0.0795 - lr: 0.0010
Epoch 8/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0896 - val_loss: 0.0699 - lr: 0.0010
Epoch 9/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0881 - val_loss: 0.0723 - lr: 0.0010
Epoch 10/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0798 - val_loss: 0.0802 - lr: 0.0010
Epoch 11/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0790 - val_loss: 0.0743 - lr: 9.0484e-04
Epoch 12/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0756 - val_loss: 0.0730 - lr: 8.1873e-04
Epoch 13/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0689 - val_loss: 0.0738 - lr: 7.4082e-04
Epoch 14/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0668 - val_loss: 0.0752 - lr: 6.7032e-04
Epoch 15/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0689 - lr: 6.0653e-04
Epoch 16/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0659 - val_loss: 0.0675 - lr: 5.4881e-04
Epoch 17/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0669 - lr: 4.9659e-04
Epoch 18/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0607 - val_loss: 0.0697 - lr: 4.4933e-04
Epoch 19/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0596 - val_loss: 0.0696 - lr: 4.0657e-04
Epoch 20/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0579 - val_loss: 0.0687 - lr: 3.6788e-04
Epoch 21/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0574 - val_loss: 0.0642 - lr: 3.0119e-04
Epoch 22/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0555 - val_loss: 0.0618 - lr: 2.4660e-04
Epoch 23/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0548 - val_loss: 0.0644 - lr: 2.0190e-04
Epoch 24/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0536 - val_loss: 0.0622 - lr: 1.6530e-04
Epoch 25/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0616 - lr: 1.3534e-04
Epoch 26/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0511 - val_loss: 0.0636 - lr: 1.1080e-04
Epoch 27/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0519 - val_loss: 0.0615 - lr: 9.0718e-05
Epoch 28/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0634 - lr: 7.4274e-05
Epoch 29/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0606 - lr: 6.0810e-05
Epoch 30/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0621 - lr: 4.9787e-05
Epoch 31/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0499 - val_loss: 0.0614 - lr: 3.6883e-05
Epoch 32/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0613 - lr: 2.7324e-05
Epoch 33/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0488 - val_loss: 0.0611 - lr: 2.0242e-05
Epoch 34/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0614 - lr: 1.4996e-05
Epoch 35/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0506 - val_loss: 0.0612 - lr: 1.1109e-05
Epoch 36/100
17/17 [==============================] - 0s 4ms/step - loss: 0.0500 - val_loss: 0.0611 - lr: 8.2297e-06
Epoch 37/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0475 - val_loss: 0.0611 - lr: 6.0967e-06
Epoch 38/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0499 - val_loss: 0.0610 - lr: 4.5166e-06
Epoch 39/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0610 - lr: 3.3460e-06
Epoch 40/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0610 - lr: 2.4788e-06
Epoch 41/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0494 - val_loss: 0.0609 - lr: 1.6616e-06
Epoch 42/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0493 - val_loss: 0.0609 - lr: 1.1138e-06
Epoch 43/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0609 - lr: 7.4659e-07
Epoch 44/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0492 - val_loss: 0.0610 - lr: 5.0045e-07
Epoch 45/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0491 - val_loss: 0.0609 - lr: 3.3546e-07
Epoch 46/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0609 - lr: 2.2487e-07
Epoch 47/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0609 - lr: 1.5073e-07
Epoch 48/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0609 - lr: 1.0104e-07
Epoch 49/100
17/17 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0609 - lr: 6.7729e-08
17/17 [==============================] - 0s 1ms/step

2023-11-27 18:44:33.010638: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.011284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.011748: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.071859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.072241: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.072611: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Epoch 1/100

2023-11-27 18:44:33.227546: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.228086: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.228466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.282855: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.283257: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.283607: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.366420: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.366970: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.367487: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.425968: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.426423: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.426844: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.675937: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.676718: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.677088: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:33.735859: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:33.736347: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:33.736761: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 1s 15ms/step - loss: 0.1354 - val_loss: 0.1160 - lr: 0.0010
Epoch 2/100
 1/26 [>.............................] - ETA: 0s - loss: 0.0582

2023-11-27 18:44:34.396746: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:34.397210: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:34.397851: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:34.460687: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:34.461079: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:34.461455: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

26/26 [==============================] - 0s 5ms/step - loss: 0.1020 - val_loss: 0.0947 - lr: 0.0010
Epoch 3/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0974 - val_loss: 0.0828 - lr: 0.0010
Epoch 4/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0911 - val_loss: 0.0818 - lr: 0.0010
Epoch 5/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0874 - val_loss: 0.0789 - lr: 0.0010
Epoch 6/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0809 - val_loss: 0.0783 - lr: 0.0010
Epoch 7/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0773 - val_loss: 0.0719 - lr: 0.0010
Epoch 8/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0740 - val_loss: 0.0672 - lr: 0.0010
Epoch 9/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0684 - val_loss: 0.0600 - lr: 0.0010
Epoch 10/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0676 - val_loss: 0.0651 - lr: 0.0010
Epoch 11/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0647 - val_loss: 0.0592 - lr: 9.0484e-04
Epoch 12/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0646 - val_loss: 0.0614 - lr: 8.1873e-04
Epoch 13/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0642 - val_loss: 0.0652 - lr: 7.4082e-04
Epoch 14/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0708 - val_loss: 0.0580 - lr: 6.7032e-04
Epoch 15/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0672 - val_loss: 0.0554 - lr: 6.0653e-04
Epoch 16/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0652 - val_loss: 0.0537 - lr: 5.4881e-04
Epoch 17/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0634 - val_loss: 0.0539 - lr: 4.9659e-04
Epoch 18/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0588 - val_loss: 0.0540 - lr: 4.4933e-04
Epoch 19/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0561 - val_loss: 0.0525 - lr: 4.0657e-04
Epoch 20/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0510 - lr: 3.6788e-04
Epoch 21/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0502 - lr: 3.0119e-04
Epoch 22/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0525 - val_loss: 0.0509 - lr: 2.4660e-04
Epoch 23/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0510 - lr: 2.0190e-04
Epoch 24/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0504 - val_loss: 0.0527 - lr: 1.6530e-04
Epoch 25/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0500 - val_loss: 0.0524 - lr: 1.3534e-04
Epoch 26/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0510 - lr: 1.1080e-04
Epoch 27/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0511 - lr: 9.0718e-05
Epoch 28/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0506 - lr: 7.4274e-05
Epoch 29/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0472 - val_loss: 0.0508 - lr: 6.0810e-05
Epoch 30/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0507 - lr: 4.9787e-05
Epoch 31/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0506 - lr: 3.6883e-05
Epoch 32/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0512 - lr: 2.7324e-05
Epoch 33/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0509 - lr: 2.0242e-05
Epoch 34/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0469 - val_loss: 0.0507 - lr: 1.4996e-05
Epoch 35/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0509 - lr: 1.1109e-05
Epoch 36/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0509 - lr: 8.2297e-06
Epoch 37/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0468 - val_loss: 0.0507 - lr: 6.0967e-06
Epoch 38/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0467 - val_loss: 0.0507 - lr: 4.5166e-06
Epoch 39/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0507 - lr: 3.3460e-06
Epoch 40/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0507 - lr: 2.4788e-06
Epoch 41/100
26/26 [==============================] - 0s 5ms/step - loss: 0.0464 - val_loss: 0.0507 - lr: 1.6616e-06
17/17 [==============================] - 0s 1ms/step

2023-11-27 18:44:39.725666: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:39.726128: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:39.726778: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:39.784295: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:39.784741: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:39.785152: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Epoch 1/100

2023-11-27 18:44:39.940419: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:39.941098: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:39.941514: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:39.998281: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:39.998673: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:39.999020: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:40.081310: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:40.081733: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:40.082167: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:40.140725: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:40.141126: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:40.141600: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:40.390074: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:40.390839: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:40.391284: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:40.450809: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:40.451247: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:40.451668: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 1s 12ms/step - loss: 0.1252 - val_loss: 0.0998 - lr: 0.0010
Epoch 2/100
 1/34 [..............................] - ETA: 0s - loss: 0.0555

2023-11-27 18:44:41.147400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:41.147874: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:41.148550: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:41.210075: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:41.210561: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:41.210964: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

34/34 [==============================] - 0s 5ms/step - loss: 0.0992 - val_loss: 0.1155 - lr: 0.0010
Epoch 3/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0949 - val_loss: 0.0901 - lr: 0.0010
Epoch 4/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0848 - val_loss: 0.0888 - lr: 0.0010
Epoch 5/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0788 - val_loss: 0.0769 - lr: 0.0010
Epoch 6/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0710 - val_loss: 0.0722 - lr: 0.0010
Epoch 7/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0666 - val_loss: 0.0696 - lr: 0.0010
Epoch 8/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0647 - val_loss: 0.0697 - lr: 0.0010
Epoch 9/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0666 - lr: 0.0010
Epoch 10/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0644 - val_loss: 0.0717 - lr: 0.0010
Epoch 11/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0590 - val_loss: 0.0618 - lr: 9.0484e-04
Epoch 12/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0597 - val_loss: 0.0631 - lr: 8.1873e-04
Epoch 13/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0563 - val_loss: 0.0647 - lr: 7.4082e-04
Epoch 14/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0553 - val_loss: 0.0608 - lr: 6.7032e-04
Epoch 15/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0552 - val_loss: 0.0733 - lr: 6.0653e-04
Epoch 16/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0543 - val_loss: 0.0596 - lr: 5.4881e-04
Epoch 17/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0539 - val_loss: 0.0774 - lr: 4.9659e-04
Epoch 18/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0526 - val_loss: 0.0650 - lr: 4.4933e-04
Epoch 19/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0823 - lr: 4.0657e-04
Epoch 20/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0583 - val_loss: 0.0918 - lr: 3.6788e-04
Epoch 21/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0692 - val_loss: 0.0774 - lr: 3.0119e-04
Epoch 22/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0651 - val_loss: 0.0601 - lr: 2.4660e-04
Epoch 23/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0584 - val_loss: 0.0567 - lr: 2.0190e-04
Epoch 24/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0526 - lr: 1.6530e-04
Epoch 25/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0499 - lr: 1.3534e-04
Epoch 26/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0524 - val_loss: 0.0488 - lr: 1.1080e-04
Epoch 27/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0511 - val_loss: 0.0483 - lr: 9.0718e-05
Epoch 28/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0509 - val_loss: 0.0480 - lr: 7.4274e-05
Epoch 29/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0502 - val_loss: 0.0476 - lr: 6.0810e-05
Epoch 30/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0503 - val_loss: 0.0474 - lr: 4.9787e-05
Epoch 31/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0495 - val_loss: 0.0473 - lr: 3.6883e-05
Epoch 32/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0473 - lr: 2.7324e-05
Epoch 33/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0471 - lr: 2.0242e-05
Epoch 34/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0471 - lr: 1.4996e-05
Epoch 35/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0470 - lr: 1.1109e-05
Epoch 36/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0470 - lr: 8.2297e-06
Epoch 37/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0470 - lr: 6.0967e-06
Epoch 38/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0470 - lr: 4.5166e-06
Epoch 39/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0470 - lr: 3.3460e-06
Epoch 40/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0469 - lr: 2.4788e-06
Epoch 41/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0479 - val_loss: 0.0469 - lr: 1.6616e-06
Epoch 42/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 1.1138e-06
Epoch 43/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0489 - val_loss: 0.0469 - lr: 7.4659e-07
Epoch 44/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0473 - val_loss: 0.0469 - lr: 5.0045e-07
Epoch 45/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0469 - lr: 3.3546e-07
Epoch 46/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0471 - val_loss: 0.0469 - lr: 2.2487e-07
Epoch 47/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0469 - lr: 1.5073e-07
Epoch 48/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 1.0104e-07
Epoch 49/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0469 - lr: 6.7729e-08
Epoch 50/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 4.5400e-08
Epoch 51/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 2.7536e-08
Epoch 52/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0469 - lr: 1.6702e-08
Epoch 53/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0469 - lr: 1.0130e-08
Epoch 54/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 6.1442e-09
Epoch 55/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0469 - lr: 3.7267e-09
Epoch 56/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0469 - lr: 2.2603e-09
Epoch 57/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 1.3710e-09
Epoch 58/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0469 - lr: 8.3153e-10
Epoch 59/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0469 - lr: 5.0435e-10
Epoch 60/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0486 - val_loss: 0.0469 - lr: 3.0590e-10
Epoch 61/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 1.6788e-10
Epoch 62/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0469 - lr: 9.2136e-11
Epoch 63/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0483 - val_loss: 0.0469 - lr: 5.0565e-11
Epoch 64/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 2.7751e-11
Epoch 65/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0469 - lr: 1.5230e-11
Epoch 66/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0496 - val_loss: 0.0469 - lr: 8.3584e-12
Epoch 67/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0476 - val_loss: 0.0469 - lr: 4.5872e-12
Epoch 68/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0478 - val_loss: 0.0469 - lr: 2.5175e-12
Epoch 69/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0469 - lr: 1.3816e-12
Epoch 70/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0482 - val_loss: 0.0469 - lr: 7.5826e-13
Epoch 71/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0469 - lr: 3.7654e-13
Epoch 72/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0474 - val_loss: 0.0469 - lr: 1.8698e-13
Epoch 73/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0485 - val_loss: 0.0469 - lr: 9.2853e-14
Epoch 74/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0480 - val_loss: 0.0469 - lr: 4.6110e-14
Epoch 75/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0481 - val_loss: 0.0469 - lr: 2.2897e-14
Epoch 76/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0477 - val_loss: 0.0469 - lr: 1.1370e-14
Epoch 77/100
34/34 [==============================] - 0s 5ms/step - loss: 0.0487 - val_loss: 0.0469 - lr: 5.6464e-15
17/17 [==============================] - 0s 1ms/step

2023-11-27 18:44:53.695622: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:53.696087: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:53.696593: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:53.753049: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:53.753493: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:53.753865: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

Epoch 1/100

2023-11-27 18:44:53.913029: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:53.913630: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:53.914031: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:53.968701: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:53.969063: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:53.969407: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:54.050316: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:54.050780: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:54.051200: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:54.110400: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:54.110785: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:54.111201: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:54.357621: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:54.358207: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:54.358745: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:54.416365: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:54.416812: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:54.417233: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 1s 11ms/step - loss: 0.1135 - val_loss: 0.0953 - lr: 0.0010
Epoch 2/100
 1/43 [..............................] - ETA: 0s - loss: 0.0554

2023-11-27 18:44:55.152454: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:55.152864: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:55.153309: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:44:55.219989: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:44:55.220711: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:44:55.221182: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

43/43 [==============================] - 0s 5ms/step - loss: 0.0950 - val_loss: 0.0857 - lr: 0.0010
Epoch 3/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0871 - val_loss: 0.0840 - lr: 0.0010
Epoch 4/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0816 - val_loss: 0.0804 - lr: 0.0010
Epoch 5/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0739 - val_loss: 0.0761 - lr: 0.0010
Epoch 6/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0663 - val_loss: 0.0735 - lr: 0.0010
Epoch 7/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0664 - val_loss: 0.0720 - lr: 0.0010
Epoch 8/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0610 - val_loss: 0.0665 - lr: 0.0010
Epoch 9/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0595 - val_loss: 0.0667 - lr: 0.0010
Epoch 10/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0577 - val_loss: 0.0653 - lr: 0.0010
Epoch 11/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0562 - val_loss: 0.0636 - lr: 9.0484e-04
Epoch 12/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0550 - val_loss: 0.0633 - lr: 8.1873e-04
Epoch 13/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0538 - val_loss: 0.0612 - lr: 7.4082e-04
Epoch 14/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0515 - val_loss: 0.0645 - lr: 6.7032e-04
Epoch 15/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0535 - val_loss: 0.0633 - lr: 6.0653e-04
Epoch 16/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0497 - val_loss: 0.0663 - lr: 5.4881e-04
Epoch 17/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0491 - val_loss: 0.0660 - lr: 4.9659e-04
Epoch 18/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0484 - val_loss: 0.0647 - lr: 4.4933e-04
Epoch 19/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0490 - val_loss: 0.0662 - lr: 4.0657e-04
Epoch 20/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0476 - val_loss: 0.0612 - lr: 3.6788e-04
Epoch 21/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0458 - val_loss: 0.0545 - lr: 3.0119e-04
Epoch 22/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0431 - val_loss: 0.0539 - lr: 2.4660e-04
Epoch 23/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0420 - val_loss: 0.0527 - lr: 2.0190e-04
Epoch 24/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0417 - val_loss: 0.0526 - lr: 1.6530e-04
Epoch 25/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0416 - val_loss: 0.0522 - lr: 1.3534e-04
Epoch 26/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0409 - val_loss: 0.0520 - lr: 1.1080e-04
Epoch 27/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0419 - val_loss: 0.0522 - lr: 9.0718e-05
Epoch 28/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0411 - val_loss: 0.0522 - lr: 7.4274e-05
Epoch 29/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0412 - val_loss: 0.0515 - lr: 6.0810e-05
Epoch 30/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0413 - val_loss: 0.0509 - lr: 4.9787e-05
Epoch 31/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0409 - val_loss: 0.0508 - lr: 3.6883e-05
Epoch 32/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0414 - val_loss: 0.0508 - lr: 2.7324e-05
Epoch 33/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0408 - val_loss: 0.0509 - lr: 2.0242e-05
Epoch 34/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0397 - val_loss: 0.0509 - lr: 1.4996e-05
Epoch 35/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0403 - val_loss: 0.0509 - lr: 1.1109e-05
Epoch 36/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0397 - val_loss: 0.0510 - lr: 8.2297e-06
Epoch 37/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0400 - val_loss: 0.0510 - lr: 6.0967e-06
Epoch 38/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0395 - val_loss: 0.0510 - lr: 4.5166e-06
Epoch 39/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0509 - lr: 3.3460e-06
Epoch 40/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0509 - lr: 2.4788e-06
Epoch 41/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0509 - lr: 1.6616e-06
Epoch 42/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0407 - val_loss: 0.0509 - lr: 1.1138e-06
Epoch 43/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0509 - lr: 7.4659e-07
Epoch 44/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0401 - val_loss: 0.0509 - lr: 5.0045e-07
Epoch 45/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0509 - lr: 3.3546e-07
Epoch 46/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0395 - val_loss: 0.0509 - lr: 2.2487e-07
Epoch 47/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0398 - val_loss: 0.0509 - lr: 1.5073e-07
Epoch 48/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0402 - val_loss: 0.0509 - lr: 1.0104e-07
Epoch 49/100
43/43 [==============================] - 0s 4ms/step - loss: 0.0399 - val_loss: 0.0509 - lr: 6.7729e-08
Epoch 50/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0394 - val_loss: 0.0509 - lr: 4.5400e-08
Epoch 51/100
43/43 [==============================] - 0s 5ms/step - loss: 0.0404 - val_loss: 0.0509 - lr: 2.7536e-08
17/17 [==============================] - 0s 1ms/step
Cross-validated RMSE: 0.06899561107519069

2023-11-27 18:45:05.252021: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:45:05.252466: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:45:05.253101: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]
2023-11-27 18:45:05.311297: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_2_grad/concat/split_2/split_dim' with dtype int32
     [[{{node gradients/split_2_grad/concat/split_2/split_dim}}]]
2023-11-27 18:45:05.311753: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_grad/concat/split/split_dim' with dtype int32
     [[{{node gradients/split_grad/concat/split/split_dim}}]]
2023-11-27 18:45:05.312228: I tensorflow/core/common_runtime/executor.cc:1197] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'gradients/split_1_grad/concat/split_1/split_dim' with dtype int32
     [[{{node gradients/split_1_grad/concat/split_1/split_dim}}]]

1.4 IV. Results

1.4.1 A. Model Performance Comparison

ARIMA (Autoregressive Integrated Moving Average) - Train RMSE: 0.011998272241271278 - Test RMSE: 0.009937797182224015 - Average CV RMSE: 0.019361682068568847

Auto_arima - Train RMSE: 0.014362240167989263 - Test RMSE: 0.030781744659889882 - Average CV RMSE: 0.030806369395818062

Univariate Prophet - Train RMSE: 0.0020426166695390077 - Test RMSE: 0.026674654082599218 - Average CV RMSE: 0.0086679294975011

Multivariate Prophet - Train RMSE: 0.01029038815089332 - Test RMSE: 0.10680624649090134 - Cross-validated RMSE: 0.011242406258430045

XGBoost - Train RMSE: 0.0063968552187190315 - Test RMSE: 0.08596906481390161 - Cross-validated RMSE: 0.06388431417642502

Keras LSTM (Long Short-Term Memory) - Train RMSE: 0.030340060238547382 - Test RMSE: 0.045407351521714524 - Cross-validated RMSE: 0.07087241651942167

Based on test RMSE, my manually tuned ARIMA model is the most successful. The worst performing model is Keras LSTM.

1.4.2 B. Analysis of Results

• Analysis of strengths and weaknesses of each model. 1. ARIMA - Strengths: - Suitable for univariate time series with a clear trend and can smooth out noise and make good short-term forecasts. - High log likelihood. - Low AIC and BIC. - Lowest test and cross-validation RMSE. - Weaknesses: - Requires manual selection/tuning of parameters which is challenging and computationally expensive. - In the context of my data, ARMA assumes a linear relationship in the data, and my dataset appears to have a more logistic growth model. - Coefficients for the AR and MA terms might not all be significantly different from zero which could be a concern for over-parameterization. - Did not capture seasonality that the auto_arima model did. - Complex model with a high order of moving average which could cause overfitting. - Heteroskedastic residuals. - Lower test RMSE than train RMSE.

2. Auto_arima

   • Strengths:
     • Automatically selects optimal model parameters (not computationally taxing).
     • Captured seasonality that the ARIMA did not.
     • High log likelihood and low AIC & BIC.
     • Significant AR terms (with low p-values).
     • Residuals which hover around 0.
   • Weaknesses:
     • In the context of my data, ARMA assumes a linear relationship in the data, and my dataset appears to have a more logistic growth
     • Struggles with long-term forecasting.
     • Heteroskedasticity.
     • Slight skew and high kurtosis.
     • Higher RMSE than manual ARIMA.

3. Univariate Prophet

   • Strengths:
     • Ability to account for seasonality and holidays effectively, and relatively easy to use.
     • Robust to overfitting for my model.
     • Returned a relatively low average cross-validated RMSE.
     • Stable cross validation performance (robust over time).
     • No systemic bias in residuals.
     • Good model fit indicators (high log likelihood, low AIC & BIC values, and low sigma2)
   • Weaknesses:
     • Good for datasets with strong seasonal effects and several seasons of historical data, which do not apply to my dataset.
     • RMSE was higher than in other models
     • Evidence of overfitting in train and test RMSE discrepancy
     • High coverage in cross-validation suggest that the prediction intervals are too wide
     • Evidence of heteroskedasticity.
     • Presence of outliers and slight skewness
     • Close alignment of cross-validated RMSE with train RMSE as opposed to test RMSE indicates that the model’s performance may vary depending on test set characteristics.

4. Multivariate Prophet

   • Strengths:
     • Can incorporate additional regressors in my dataset.
     • Ability to account for seasonality and holidays effectively, and relatively easy to use.
     • Flexible trend modeling (better adaptation to complex data patterns)
     • Effective handling of seasonality (multiplicative seasonality)
     • Low cross-validated RMSE reinforces its robustness and reliability.
     • Increased regularization for holiday effects may have helped to manage overfitting.
   • Weaknesses:
     • Potential overfitting/complexity from additional regressors.
     • Feature selection of additional regressors is difficult and could introduce noise
     • Evidence of overfitting in significant discrepancy between train and test RMSE
     • Possibility of complex interactions due to multiple regressors.
     • Risk of misinterpretation of multiple variables especially with the presence of multicollinearity.

5. XGBoost

   • Strengths:
     • Can capture complex, non-linear relationships in data.
     • Robust to outliers.
     • Can handle NaN values and does not need data to be grouped by Date.
     • Provides insight into feature importance.
     • Flexibility allows it to adapt well to various data types and distributions.
     • Good performance on training data.
   • Weaknesses:
     • Not inherently a time series model.
     • Tuning is computationally expensive (I was unable to perform a GridSearchCV).
     • Evidence of overfitting.
     • Relatively high test RMSE

6. Keras LSTM

   • Strengths:
     • Can capture complex, non-linear relationships, and long-term dependencies in data.
     • Highly flexible.
     • Improved performance with preprocessing.
     • Effective capture of time-dependent patterns
     • Model can explain a significant proportion of variance in the training set (high training R-squared indicates good fit).
     • Adaptability to non-linear patterns.
   • Weaknesses:
     • Requires large amounts of data to train effectively, and my dataset was quite small.
     • Computationally intensive and requires a lot of manual effort to tune.
     • Overfitting indicated by RMSE discrepancy.
     • High cross-validated RMSE indicates low generalizability.
     • High sensitivity to hyperparameter settings.

I believe that there are many factors that contributed to my manually tuned ARIMA model being the best-performing one. In terms of the parameters, the p,d,q selection (0,1,6) reflects a well-tuned balance between both the AR and MA components of the model so that it could capture both short- and long-term trends. As for the d term, I believe that the use of first-order differencing likely aided in stabilizing the mean of the time series allowing it a suitable amount of stationarity for ARIMA models. Next, the sixth-order MA parameter suggests that the ARIMA model can capture complex error structures and longer lagged dependencies (6.2 Moving Averages | Forecasting: Principles and Practice (2nd Ed), n.d.). Furthermore, the lack of seasonal components compared to auto_arima indicates that success may be due to the time series data not having strong seasonal patterns. It’s important to note that my univariate Prophet model had the lowest cross validated RMSE. I believe this may be because it is less sensitive to certain data variations due to its robustness against outliers and missing data. It could be more stable across different folds of cross-validation, leading to a lower average RMSE.

Next, I believe that the simplicity of ARIMA as a model generally speaking may have leant to its success. This may have been bolstered by the lack of additional regressors. As I have mentioned, the test dataset is quite simple due to the cumulative nature of the response variable asymptotically reaching 100% vaccine completion. Furthermore, the high log likelihood and low AIC & BIC indicate that the ARIMA model is able to balance good fit and low complexity. There has been evidence of other academics using ARIMA models for cumulative COVID-19 data (ArunKumar et al., 2021). This structure might be well-suited to any autocorrelation issues in the data.

1.5 V. Discussion

I believe the lack of success of these models is purely due to the nature of the dataset at hand. Although it was initially approved, many issues with it affected its quality for time-series modeling. The actual train and test sets that I used ended up being extremely small due to the elimination of observations that occurred before the booster vaccines were created, grouping by Date for those models that needed it, and switching the data to weekly frequency to match the observation cadence from the later parts of the dataset. Additionally, the cumulative nature of the dataset made it inept for time series-modeling.

As for the actual models themselves, overfitting was one of the biggest issues I faced. I think that this may have been because of the severe change in data trends from the train to the test sets as the vaccination rate asymptotically approached 100%. Some of the models that included many parameters such as XGBoost, multivariate Prophet, and Keras LSTM could have fit too closely to the training data and therefore had trouble generalizing to unseen test data. Specifically, the LSTM model relies on large datasets and is powerful in capturing long-term dependencies as opposed to data that accumulates over time (Guide & Saxena, 2023). Another issue is that I did not have the time nor computational resources to perform extensive tuning for all six models. XGBoost, for example, relies on extensive grid search to ensure the best parameters are selected, and I did not have the time to run these. For LSTM, it is also difficult to determine the optimal number of layers and it can take a lot of trial and error to do so. Finally, based on the results of many of the models, heteroskedasticity, residual issues, and inability to capture complex interactions for many of the multivariate models may have led to poor performance.

I feel that this experience was valuable and that I gained knowledge on time-series modeling. I did not have any exposure to time-series modeling aside from the brief unit in Stat 303-2 before this class, and I now feel like I have a solid understanding of the modeling process. Furthermore, I had only used XGBoost and Keras LSTM before this class, so it was a great experience to bolster my skills on those and gain exposure to the other four models. Finally, I now feel more comfortable using GitHub and working on other branches as I had never done that in my previous data science projects.

I enjoyed the group aspect of the project as I felt it was easy to troubleshoot issues, divide duties based on our skills, and efficiently collaborate to produce our best work. I felt like my group worked well with one another and we did not have issues with leadership or responsibility splits. Regarding aspects of the project I was less keen about, I wish that the group element of the project continued until the project report. I feel like I would have still gained exposure to the other models in addition to having time to ensure I achieved the best models for my allocated two. Furthermore, I understand that much of this project was meant for us to research these new models; however, it would have been helpful to have received instruction on how to develop and tune some of the new ones aside from the notebook that Professor Shi published.

1.6 VI. Conclusion

Ultimately, although I achieved some models with relatively low RMSEs, I would say that this project was marked by issues due to the nature of the data. The cumulative nature of the response variable presented unique challenges which affected the performance and suitability of many of the models. As a result, many of the models exhibited signs of overfitting and models that were more complex did not yield results that were better than simpler models. Feature engineering clearly had a significant impact on model performance, and models such as XGBoost revealed that age-specific vaccination rates and manufacturer-specific data proved crucial in some models. Finally, models that could incorporate seasonality such as ARIMA and Prophet tended to demonstrate more accurate forecasting capabilities.

As for specific model findings, the manually tuned ARIMA model emerged as the best performing in capturing the COVID dataframe’s time series dynamics. Auto ARIMA was unable to outperform the manually tuned ARIMA, although the manually tuned ARIMA model had the unusual result of the test RMSE being lower than the train RMSE most likely due to the simplicity of the test set. Both of the Prophet models showed reasonable performance aside from overfitting issues with the univariate model performing better by effectively handling seasonality and trend changes. Despite its powerful and efficient algorithm, the XGBoost model suffered from overfitting, but revealed important insights on feature importances. Finally, the Keras LSTM model struggled with the cumulative and small nature of the dataset resulting in underperformance.

Overall, the cross-validated RMSEs provided a realistic insight on each model’s performance compared to test and train RMSEs and helped to reveal overfitting issues. This project emphasized the importance of model selection for data science issues, and that exploratory data analysis and data preprocessing are imperative to success. Finally, a combination of manual tuning and automatic modeling processes led to modeling success.

Our team worked very effectively together during this project. In our collaborative activities, such as creating presentations and reports, we equally contributed and managed to divide the work efficiently. We recognized and utilized each other’s strengths, which was instrumental in our success. Meeting both in person and over Zoom was crucial, as it allowed us to work together on challenging aspects of the project, like debugging or understanding complex concepts.

From this experience, I’ve learned the importance of acknowledging and leveraging the unique strengths of team members. I now understand that a significant aspect of group work is strategically dividing responsibilities. It’s impossible for one person to cover every aspect of a project efficiently. Having a clear plan and set deadlines is also essential for successful collaboration. In future projects, I plan to focus on identifying where I and my teammates excel to develop an effective strategy for collaborative work.

1.7 VII. References

References

Abulkhair, A. (2023, June 13). Data Imputation Demystified | Time Series Data | by Ahmed Abulkhair. Medium. Retrieved October 25, 2023, from https://medium.com/@aaabulkhair/data-imputation-demystified-time-series-data-69bc9c798cb7

Aggarwal, S. (2023, November 16). The Ultimate Guide to Building Your Own LSTM Models. ProjectPro. Retrieved November 21, 2023, from https://www.projectpro.io/article/lstm-model/832

ArunKumar, K.E., Kalaga, D. V., Kumar, C. M. S., Chilkoor, G., Kawaji, M., & Brenza, T. M. (2021, February 8). Forecasting the dynamics of cumulative COVID-19 cases (confirmed, recovered and deaths) for top-16 countries using statistical machine learning models: Auto-Regressive Integrated Moving Average (ARIMA) and Seasonal Auto-Regressive Integrated Moving Average. National Library of Medicine, 103(107161).

Brownlee, J. (2021, March 19). How to Use XGBoost for Time Series Forecasting - MachineLearningMastery.com. Machine Learning Mastery. Retrieved November 20, 2023, from https://machinelearningmastery.com/xgboost-for-time-series-forecasting/

Brownlee, J. (2023, November 18). How to Create an ARIMA Model for Time Series Forecasting in Python - MachineLearningMastery.com. Machine Learning Mastery. Retrieved November 22, 2023, from https://machinelearningmastery.com/arima-for-time-series-forecasting-with-python/

Chollet, F. (n.d.). LSTM layer. Keras. https://keras.io/api/layers/recurrent_layers/lstm/

Chowdhury, K. (2021, May 24). 10 Hyperparameters to keep an eye on for your LSTM model — and other tips. Medium. Retrieved November 21, 2023, from https://medium.com/geekculture/10-hyperparameters-to-keep-an-eye-on-for-your-lstm-model-and-other-tips-f0ff5b63fcd4

Dancho, M. (2017, July 23). Tidy Time Series Analysis, Part 2: Rolling Functions. Business Science. Retrieved November 20, 2023, from https://www.business-science.io/timeseries-analysis/2017/07/23/tidy-timeseries-analysis-pt-2.html 4.1 Seasonal ARIMA models | STAT 510. (n.d.). STAT ONLINE. Retrieved November 22, 2023, from https://online.stat.psu.edu/stat510/lesson/4/4.1

Guide, S., & Saxena, S. (2023, October 25). What is LSTM? Introduction to Long Short-Term Memory. Analytics Vidhya. Retrieved November 26, 2023, from https://www.analyticsvidhya.com/blog/2021/03/introduction-to-long-short-term-memory-lstm/

Hahn, S. (n.d.). COVID-19 Vaccines. FDA. Retrieved October 25, 2023, from https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/covid-19-vaccines

Hedengren, J. D. (2022). LSTM Networks | Dynamic Optimization. APMonitor. Retrieved November 21, 2023, from https://apmonitor.com/do/index.php/Main/LSTMNetwork

Howson, I. (2023, September 2).* prophet_params: Tuning Parameters for Prophet Models in modeltime: The Tidymodels Extension for Time Series Modeling.* rdrr.io. Retrieved November 24, 2023, from https://rdrr.io/cran/modeltime/man/prophet_params.html Hyndman, R. J., & Athanasopoulos, G. (n.d.). 8.1 Stationarity and differencing | Forecasting: Principles and Practice (2nd ed). OTexts. Retrieved November 23, 2023, from https://otexts.com/fpp2/stationarity.html

Jain, S. (2023, February 6). XGBoost. GeeksforGeeks. Retrieved November 20, 2023, from https://www.geeksforgeeks.org/xgboost/#

Kates, J., Tolbert, J., & Rouw, A. (2021, December 8). An Update on Vaccine Roll-Out for 5-11 Year-olds in the U.S. KFF. Retrieved October 25, 2023, from https://www.kff.org/coronavirus-covid-19/issue-brief/an-update-on-vaccine-roll-out-for-5-11-year-olds-in-the-u-s/

Marks, P. (2022, June 30). Coronavirus (COVID-19) Update: FDA Recommends Inclusion of Omicron BA.4/5 Component for COVID-19 Vaccine Booster Doses. FDA. Retrieved November 19, 2023, from https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-recommends-inclusion-omicron-ba45-component-covid-19-vaccine-booster

Montel, M. (2017). holidays · PyPI. PyPI. Retrieved October 25, 2023, from https://pypi.org/project/holidays/

Munichiello, K. Á. (2023, September 29). Autoregressive Integrated Moving Average (ARIMA) Prediction Model. Investopedia. Retrieved November 22, 2023, from https://www.investopedia.com/terms/a/autoregressive-integrated-moving-average-arima.asp

National Institute of Standards and Technology (NIST). (n.d.). 6.4.4.2. Stationarity. Information Technology Laboratory. Retrieved November 23, 2023, from https://www.itl.nist.gov/div898/handbook/pmc/section4/pmc442.htm

Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V.,

Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., & Duchesnay, E. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825–2830. https://scikit-learn.org/stable/about.html#citing-scikit-learn Pramoditha, R. (2022, July 30). One-hot Encode Scalar-value Labels for Deep Learning Models. Medium. Retrieved November 21, 2023, from https://medium.com/data-science-365/one-hot-encode-scalar-value-labels-for-deep-learning-models-4d4053f185c5

Prophet | Forecasting at scale. (n.d.). Meta Open Source. Retrieved November 24, 2023, from https://facebook.github.io/prophet/

Saturating Forecasts | Prophet. (n.d.). Meta Open Source. Retrieved November 25, 2023, from https://facebook.github.io/prophet/docs/saturating_forecasts.html#saturating-minimum

Schmudde, D. (2019, July 26).* Facebook Prophet: Diagnostics.* Nextjournal. Retrieved November 25, 2023, from https://nextjournal.com/fb-prophet/facebook-prophet-diagnostics

6.2 Moving averages | Forecasting: Principles and Practice (2nd ed). (n.d.). OTexts. Retrieved November 26, 2023, from https://otexts.com/fpp2/moving-averages.html

Smith, T. (2017). pmdarima.arima.auto_arima — pmdarima 2.0.4 documentation. alkaline-ml. Retrieved November 23, 2023, from https://alkaline-ml.com/pmdarima/modules/generated/pmdarima.arima.auto_arima.html

xgboost developers. (2022). Python API Reference — xgboost 2.0.2 documentation. XGBoost Documentation. Retrieved November 21, 2023, from https://xgboost.readthedocs.io/en/stable/python/python_api.html

1.8 VIII. Appendices

1.8.1 ARIMA

#### Initial Benchmarking Models

Code

# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(1, 0, 0))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())

                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 0, 0)   Log Likelihood                 117.310
Date:                      Mon, 27 Nov 2023   AIC                           -228.619
Time:                              18:45:05   BIC                           -222.543
Sample:                          11-03-2021   HQIC                          -226.264
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const          0.4965      0.532      0.933      0.351      -0.546       1.539
ar.L1          0.9982      0.023     42.912      0.000       0.953       1.044
sigma2         0.0008      0.000      4.216      0.000       0.000       0.001
===================================================================================
Ljung-Box (L1) (Q):                  32.42   Jarque-Bera (JB):                16.20
Prob(Q):                              0.00   Prob(JB):                         0.00
Heteroskedasticity (H):               0.01   Skew:                             1.27
Prob(H) (two-sided):                  0.00   Kurtosis:                         3.72
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Code

# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(0, 0, 1))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(0, 0, 1)   Log Likelihood                  33.693
Date:                      Mon, 27 Nov 2023   AIC                            -61.386
Time:                              18:45:05   BIC                            -55.310
Sample:                          11-03-2021   HQIC                           -59.030
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const          0.7504      0.067     11.123      0.000       0.618       0.883
ma.L1          0.9998     58.844      0.017      0.986    -114.333     116.333
sigma2         0.0164      0.963      0.017      0.986      -1.871       1.904
===================================================================================
Ljung-Box (L1) (Q):                  32.46   Jarque-Bera (JB):                95.52
Prob(Q):                              0.00   Prob(JB):                         0.00
Heteroskedasticity (H):               0.24   Skew:                            -2.14
Prob(H) (two-sided):                  0.00   Kurtosis:                         7.76
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Code

# Initialize the ARIMA model
model_ar1 = ARIMA(train_ar, order=(2, 0, 2))

# Fit the ARIMA model
fitted_model_ar1 = model_ar1.fit()

# Print out the summary of the fit model
print(fitted_model_ar1.summary())

                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(2, 0, 2)   Log Likelihood                 147.204
Date:                      Mon, 27 Nov 2023   AIC                           -282.409
Time:                              18:45:05   BIC                           -270.257
Sample:                          11-03-2021   HQIC                          -277.697
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
const          0.4692      0.451      1.042      0.298      -0.414       1.352
ar.L1          0.2810      0.157      1.793      0.073      -0.026       0.588
ar.L2          0.7131      0.149      4.783      0.000       0.421       1.005
ma.L1          1.8141      0.447      4.059      0.000       0.938       2.690
ma.L2          0.9725      0.469      2.075      0.038       0.054       1.891
sigma2         0.0002      0.000      2.289      0.022    3.56e-05       0.000
===================================================================================
Ljung-Box (L1) (Q):                   0.00   Jarque-Bera (JB):                27.53
Prob(Q):                              0.95   Prob(JB):                         0.00
Heteroskedasticity (H):               0.08   Skew:                             1.31
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.21
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

#### Tuning procedure with rolling forecast

Code

# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    error = mean_squared_error(test_data, predictions)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ar, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ar.values, test_ar.values, param)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ar.index[0], end=train_ar.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ar, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")

ARIMA(0, 0, 0) - AIC:4.247377915841888

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 0) - Test RMSE: 0.19689682599508618
ARIMA(0, 0, 1) - AIC:-61.386166557230766

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 1) - Test RMSE: 0.1019191370564995
ARIMA(0, 0, 2) - AIC:-120.75241682724243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 2) - Test RMSE: 0.057198496179134306
ARIMA(0, 0, 3) - AIC:-167.77581727403606

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 3) - Test RMSE: 0.03252307691385174
ARIMA(0, 0, 4) - AIC:-208.98721984355345

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 4) - Test RMSE: 0.024613571459282953
ARIMA(0, 0, 5) - AIC:-238.79317806887153

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 5) - Test RMSE: 0.014536313016410257
ARIMA(0, 0, 6) - AIC:-260.72140641203134

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 6) - Test RMSE: 0.012105676352473728
ARIMA(0, 1, 0) - AIC:-233.93423132271894
ARIMA(0, 1, 0) - Test RMSE: 0.001638176583743459
ARIMA(0, 1, 1) - AIC:-281.8755026362179

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 1) - Test RMSE: 0.0010609016327302642
ARIMA(0, 1, 2) - AIC:-317.04502425321454

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 2) - Test RMSE: 0.0009347626816272875
ARIMA(0, 1, 3) - AIC:-334.6221693724792

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 3) - Test RMSE: 0.0014870537589369954
ARIMA(0, 1, 4) - AIC:-341.17129968294756

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 4) - Test RMSE: 0.0010917579260762474
ARIMA(0, 1, 5) - AIC:-344.26377726332

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 5) - Test RMSE: 0.0009591114496682588
ARIMA(0, 1, 6) - AIC:-354.75089008501647

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 6) - Test RMSE: 0.0013058042895714801
ARIMA(0, 2, 0) - AIC:-381.44345120781577

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 0) - Test RMSE: 0.0007879147333206601
ARIMA(0, 2, 1) - AIC:-382.8312301530113
ARIMA(0, 2, 1) - Test RMSE: 0.0007342490373780269
ARIMA(0, 2, 2) - AIC:-380.8791307958302

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 2) - Test RMSE: 0.0007314521796732864
ARIMA(0, 2, 3) - AIC:-378.92034573917493

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 3) - Test RMSE: 0.0007325634592131251
ARIMA(0, 2, 4) - AIC:-385.57523592106753

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 4) - Test RMSE: 0.001159241575397781
ARIMA(0, 2, 5) - AIC:-382.91815096136696

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 5) - Test RMSE: 0.0010718138463683647
ARIMA(0, 2, 6) - AIC:-383.45095430858504

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 6) - Test RMSE: 0.0009897008141751056
ARIMA(1, 0, 0) - AIC:-228.61918020716223

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 0) - Test RMSE: 0.0022737166421355733
ARIMA(1, 0, 1) - AIC:-269.24796001003426

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 1) - Test RMSE: 0.005404585931399144
ARIMA(1, 0, 2) - AIC:-307.1027082494086

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 2) - Test RMSE: 0.004365683947512756
ARIMA(1, 0, 3) - AIC:-329.1694480883456

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 3) - Test RMSE: 0.0020964879671221295
ARIMA(1, 0, 4) - AIC:-335.013299468729

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 4) - Test RMSE: 0.0023322136470668876
ARIMA(1, 0, 5) - AIC:-337.7136153956957

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 5) - Test RMSE: 0.0020479490548349077
ARIMA(1, 0, 6) - AIC:-332.4450350634247

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 6) - Test RMSE: 0.0034189651106060295
ARIMA(1, 1, 0) - AIC:-382.877948427655

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 0) - Test RMSE: 0.0007732110928795112
ARIMA(1, 1, 1) - AIC:-384.23718277178415

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 1) - Test RMSE: 0.0007252399068664201
ARIMA(1, 1, 2) - AIC:-382.3689356103163

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 2) - Test RMSE: 0.0007249542934853802
ARIMA(1, 1, 3) - AIC:-374.2438675173964

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 3) - Test RMSE: 0.000782814395861608
ARIMA(1, 1, 4) - AIC:-387.97730073335714

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 4) - Test RMSE: 0.0017134809487848687
ARIMA(1, 1, 5) - AIC:-388.7020424979628

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 5) - Test RMSE: 0.0011155590927342265
ARIMA(1, 1, 6) - AIC:-388.4099480064063

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 6) - Test RMSE: 0.00123734818874504
ARIMA(1, 2, 0) - AIC:-382.8776751931645

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 0) - Test RMSE: 0.0007381664319877718
ARIMA(1, 2, 1) - AIC:-380.87007247939215

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 1) - Test RMSE: 0.0007364183066952584
ARIMA(1, 2, 2) - AIC:-375.7907461572404

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 2) - Test RMSE: 0.0011117819342048353
ARIMA(1, 2, 3) - AIC:-377.41886357440137

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 3) - Test RMSE: 0.0007288358572307232
ARIMA(1, 2, 4) - AIC:-383.63415198973996

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 4) - Test RMSE: 0.0010112311290048517
ARIMA(1, 2, 5) - AIC:-385.0860947023966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 5) - Test RMSE: 0.001005185695742508
ARIMA(1, 2, 6) - AIC:-382.50216905749863

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 6) - Test RMSE: 0.0010431592839520952
ARIMA(2, 0, 0) - AIC:-373.16946963052357

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 0) - Test RMSE: 0.0021560403099509877
ARIMA(2, 0, 1) - AIC:-376.1986841777029

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 1) - Test RMSE: 0.0023064402318947615
ARIMA(2, 0, 2) - AIC:-282.4086129935133

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 2) - Test RMSE: 0.0027854421827834
ARIMA(2, 0, 3) - AIC:-311.3186709873355

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 3) - Test RMSE: 0.0017284632612331557
ARIMA(2, 0, 4) - AIC:-328.1302481051966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 4) - Test RMSE: 0.001821546705616348
ARIMA(2, 0, 5) - AIC:-331.6524564508811

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 5) - Test RMSE: 0.0016393788620216896
ARIMA(2, 0, 6) - AIC:-292.10284992382935

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 6) - Test RMSE: 0.008405113630402087
ARIMA(2, 1, 0) - AIC:-384.368303927542

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 0) - Test RMSE: 0.0007367568552582056
ARIMA(2, 1, 1) - AIC:-382.1998843707397

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 1) - Test RMSE: 0.0007578723701840571
ARIMA(2, 1, 2) - AIC:-380.8129483990026

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 2) - Test RMSE: 0.0007433679604867638
ARIMA(2, 1, 3) - AIC:-378.72694645280524

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 3) - Test RMSE: 0.0007581204748123403
ARIMA(2, 1, 4) - AIC:-377.06711037555243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 4) - Test RMSE: 0.0007194634650386461
ARIMA(2, 1, 5) - AIC:-384.2577072621762

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 5) - Test RMSE: 0.001167145444086536
ARIMA(2, 1, 6) - AIC:-386.6125135638169

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 6) - Test RMSE: 0.001159203264746481
ARIMA(2, 2, 0) - AIC:-380.8901883396523

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 0) - Test RMSE: 0.0007360772804361125
ARIMA(2, 2, 1) - AIC:-378.89418192149424

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 1) - Test RMSE: 0.000735186059287429
ARIMA(2, 2, 2) - AIC:-376.90090791610766

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 2) - Test RMSE: 0.000731458173655972
ARIMA(2, 2, 3) - AIC:-378.4137824836483

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 3) - Test RMSE: 0.0007085978823558145
ARIMA(2, 2, 4) - AIC:-381.2931815248008

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 4) - Test RMSE: 0.0007603620097464024
ARIMA(2, 2, 5) - AIC:-383.15434495370494

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 5) - Test RMSE: 0.0009086549859147037
ARIMA(2, 2, 6) - AIC:-382.9672222960308

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 6) - Test RMSE: 0.001136232470792607
ARIMA(1, 1, 5) with lowest AIC of -388.7020424979628
ARIMA(2, 2, 3) with lowest test RMSE of 0.0007085978823558145
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 1, 5)   Log Likelihood                 201.351
Date:                      Mon, 27 Nov 2023   AIC                           -388.702
Time:                              18:46:11   BIC                           -374.651
Sample:                          11-03-2021   HQIC                          -383.268
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.9451      0.022     42.845      0.000       0.902       0.988
ma.L1         -0.3162      0.200     -1.584      0.113      -0.707       0.075
ma.L2          0.1448      0.158      0.915      0.360      -0.165       0.455
ma.L3         -0.0399      0.198     -0.201      0.840      -0.428       0.348
ma.L4          0.2786      0.242      1.153      0.249      -0.195       0.752
ma.L5          0.3989      0.215      1.854      0.064      -0.023       0.821
sigma2      3.529e-05   1.27e-05      2.787      0.005    1.05e-05    6.01e-05
===================================================================================
Ljung-Box (L1) (Q):                   1.41   Jarque-Bera (JB):                20.36
Prob(Q):                              0.24   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.79
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.53
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 3) - Train RMSE: 0.011363769653325214
Best ARIMA(2, 2, 3) - Test RMSE: 0.0007085978823558145

Code

# Define the ARIMA order
arima_order113 = (1, 1, 3)

# Fit the ARIMA model
model113 = ARIMA(train_ar, order=arima_order113)
fitted_model113 = model113.fit()

# Predict on the training set
train_pred_ar113 = fitted_model113.predict(start=train_ar.index[0], end=train_ar.index[-1], typ='levels')

# Predict on the test set
test_pred_ar113 = fitted_model113.predict(start=test_ar.index[0], end=test_ar.index[-1], typ='levels')

# Calculate RMSE for train and test sets
train_rmse_ar113 = np.sqrt(mean_squared_error(train_ar, train_pred_ar113))
test_rmse_ar113 = np.sqrt(mean_squared_error(test_ar, test_pred_ar113))

# Print RMSE values
print(f"Train RMSE: {train_rmse_ar113}")
print(f"Test RMSE: {test_rmse_ar113}")

# Model summary
fitted_model113.summary()

Train RMSE: 0.011380421280512386
Test RMSE: 0.013461639971627658

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

SARIMAX Results

Dep. Variable:	Additional_Doses_Vax_Pct	No. Observations:	56
Model:	ARIMA(1, 1, 3)	Log Likelihood	192.122
Date:	Mon, 27 Nov 2023	AIC	-374.244
Time:	18:46:12	BIC	-364.207
Sample:	11-03-2021	HQIC	-370.363
	- 11-23-2022
Covariance Type:	opg

	coef	std err	z	P>|z|	[0.025	0.975]
ar.L1	0.9352	0.031	30.139	0.000	0.874	0.996
ma.L1	0.0111	0.112	0.099	0.921	-0.209	0.231
ma.L2	0.1620	0.180	0.900	0.368	-0.191	0.515
ma.L3	-0.0638	0.143	-0.446	0.656	-0.344	0.217
sigma2	5.206e-05	8.51e-06	6.116	0.000	3.54e-05	6.87e-05

Ljung-Box (L1) (Q):	2.61	Jarque-Bera (JB):	53.62
Prob(Q):	0.11	Prob(JB):	0.00
Heteroskedasticity (H):	0.01	Skew:	1.07
Prob(H) (two-sided):	0.00	Kurtosis:	7.33

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).

My results here are still worse compared to the other model types I have looked at. I wanted to experiment with scaled data too as it had helped in my model development in other models. So, I underwent the same process with scaled data.

Code

# Import data with specific columns
df_ars = pd.read_csv('df_post_eda.csv', usecols=['Date', pred_var])

# Convert 'Date' to datetime
df_ars['Date'] = pd.to_datetime(df_ars['Date'])

# Group by 'Date' to ensure there is one unique value per date
df_ars = df_ars.groupby('Date').mean()

# Sorting the DataFrame by the index
df_ars.sort_index(inplace=True)

# Initialize the MinMaxScaler to scale data between 0 and 1
scaler = MinMaxScaler(feature_range=(0, 1))

# Scale the predictive variable column
df_ars[pred_var] = scaler.fit_transform(df_ars[[pred_var]])

# Calculate the index for the 70-30 split
split_index = int(len(df_ars) * 0.7)

# Split into train and test
train_ars = df_ars.iloc[:split_index][pred_var]
test_ars = df_ars.iloc[split_index:][pred_var]

# Rolling forecast origin evaluation function
def rolling_forecast_origin(train_data, test_data, arima_order, scaler):
    history = [x for x in train_data]
    predictions = []
    for t in range(len(test_data)):
        model = ARIMA(history, order=arima_order)
        model_fit = model.fit()
        yhat = model_fit.forecast()[0]
        predictions.append(yhat)
        history.append(test_data[t])
    # Scale predictions back to original scale
    predictions_scaled = scaler.inverse_transform(np.array(predictions).reshape(-1, 1)).flatten()
    test_data_scaled = scaler.inverse_transform(test_data.reshape(-1, 1)).flatten()
    error = mean_squared_error(test_data_scaled, predictions_scaled)
    return np.sqrt(error)

# Define the p, d, and q parameter ranges
p = d = range(0, 3)
q = range(0, 7)

# Generate all different combinations of p, d, and q triplets
pdq = list(itertools.product(p, d, q))

# Record AIC scores and RMSE
aic_scores = []
rmse_scores = []

best_aic_model = None
lowest_aic = float('inf')
best_rmse_model = None
lowest_rmse = float('inf')

# Run a grid search over different p,d,q combinations
for param in pdq:
    try:
        mod = ARIMA(train_ars, order=param)
        results = mod.fit()
        aic = results.aic
        aic_scores.append((param, aic))
        print('ARIMA{} - AIC:{}'.format(param, aic))

        if aic < lowest_aic:
            best_aic_model = (param, results)
            lowest_aic = aic

        # Use the rolling forecast origin approach for RMSE calculation
        test_rmse = rolling_forecast_origin(train_ars.values, test_ars.values, param, scaler)
        rmse_scores.append((param, test_rmse))
        print(f'ARIMA{param} - Test RMSE: {test_rmse}')

        if test_rmse < lowest_rmse:
            best_rmse_model = (param, results)
            lowest_rmse = test_rmse

    except Exception as e:
        print(f'Error fitting ARIMA{param}: {e}')
        continue

# Find the parameters with minimal AIC value
print(f"ARIMA{best_aic_model[0]} with lowest AIC of {lowest_aic}")

# Find the parameters with minimal test RMSE value
print(f"ARIMA{best_rmse_model[0]} with lowest test RMSE of {lowest_rmse}")

# Use the best AIC parameters to fit the model
best_aic_fitted_model = best_aic_model[1]
print(best_aic_fitted_model.summary())

# Use the best RMSE parameters to fit the model
best_rmse_fitted_model = best_rmse_model[1]
best_rmse_summary = best_rmse_fitted_model.summary()

# Print the train and test RMSE for the best RMSE model
best_rmse_param, best_rmse_results = best_rmse_model
train_pred_rmse = best_rmse_results.predict(start=train_ars.index[0], end=train_ars.index[-1], dynamic=False)
train_rmse_best = np.sqrt(mean_squared_error(train_ars, train_pred_rmse))
test_rmse_best = lowest_rmse
print(f"Best ARIMA{best_rmse_param} - Train RMSE: {train_rmse_best}")
print(f"Best ARIMA{best_rmse_param} - Test RMSE: {test_rmse_best}")

ARIMA(0, 0, 0) - AIC:4.247377915841888

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 0) - Test RMSE: 8.022315054137293
ARIMA(0, 0, 1) - AIC:-61.386166557230766
ARIMA(0, 0, 1) - Test RMSE: 4.152567840445752
ARIMA(0, 0, 2) - AIC:-120.75241682724243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 2) - Test RMSE: 2.330481228698602
ARIMA(0, 0, 3) - AIC:-167.77581727403606

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 3) - Test RMSE: 1.3251121150087455
ARIMA(0, 0, 4) - AIC:-208.98721984355345

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 4) - Test RMSE: 1.0028492021441597
ARIMA(0, 0, 5) - AIC:-238.79317806887153

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 5) - Test RMSE: 0.5922639034623632
ARIMA(0, 0, 6) - AIC:-260.72140641203134

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 0, 6) - Test RMSE: 0.49323065088610085
ARIMA(0, 1, 0) - AIC:-233.93423132271894
ARIMA(0, 1, 0) - Test RMSE: 0.06674545718389763
ARIMA(0, 1, 1) - AIC:-281.8755026362179

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 1) - Test RMSE: 0.04322511089855245
ARIMA(0, 1, 2) - AIC:-317.04502425321454

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 2) - Test RMSE: 0.03808573700955253
ARIMA(0, 1, 3) - AIC:-334.6221693724792

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 3) - Test RMSE: 0.06058814659068853
ARIMA(0, 1, 4) - AIC:-341.17129968294756

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 4) - Test RMSE: 0.04448231200056827
ARIMA(0, 1, 5) - AIC:-344.26377726332

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 5) - Test RMSE: 0.03907779712741948
ARIMA(0, 1, 6) - AIC:-354.75089008501647

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 1, 6) - Test RMSE: 0.05320336352322743
ARIMA(0, 2, 0) - AIC:-381.44345120781577

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 0) - Test RMSE: 0.03210260091573463
ARIMA(0, 2, 1) - AIC:-382.8312301530113
ARIMA(0, 2, 1) - Test RMSE: 0.029916059216671963
ARIMA(0, 2, 2) - AIC:-380.8791307958302

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 2) - Test RMSE: 0.029802104745564086
ARIMA(0, 2, 3) - AIC:-378.92034573917493

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 3) - Test RMSE: 0.02984738244131613
ARIMA(0, 2, 4) - AIC:-385.57523592106753

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 4) - Test RMSE: 0.047231848937613924
ARIMA(0, 2, 5) - AIC:-382.91815096136696

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 5) - Test RMSE: 0.043669715402971335
ARIMA(0, 2, 6) - AIC:-383.45095430858504

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(0, 2, 6) - Test RMSE: 0.04032412254754755
ARIMA(1, 0, 0) - AIC:-228.61918020716223

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 0) - Test RMSE: 0.09263974243801132
ARIMA(1, 0, 1) - AIC:-269.24796001003426

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 1) - Test RMSE: 0.22020309804244445
ARIMA(1, 0, 2) - AIC:-307.1027082494086

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 2) - Test RMSE: 0.17787433533647254
ARIMA(1, 0, 3) - AIC:-329.1694480883456

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 3) - Test RMSE: 0.08541878161043201
ARIMA(1, 0, 4) - AIC:-335.013299468729

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 4) - Test RMSE: 0.09502312978268243
ARIMA(1, 0, 5) - AIC:-337.7136153956957

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 5) - Test RMSE: 0.0834411243029291
ARIMA(1, 0, 6) - AIC:-332.4450350634247

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 0, 6) - Test RMSE: 0.1393014597252537
ARIMA(1, 1, 0) - AIC:-382.877948427655

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 0) - Test RMSE: 0.03150351946550972
ARIMA(1, 1, 1) - AIC:-384.23718277178415

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 1) - Test RMSE: 0.029548993455389843
ARIMA(1, 1, 2) - AIC:-382.3689356103163

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 2) - Test RMSE: 0.029537356495194723
ARIMA(1, 1, 3) - AIC:-374.2438675173964

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 3) - Test RMSE: 0.0318947940413857
ARIMA(1, 1, 4) - AIC:-387.97730073335714

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 4) - Test RMSE: 0.069813639407052
ARIMA(1, 1, 5) - AIC:-388.7020424979628

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 5) - Test RMSE: 0.04545206078459003
ARIMA(1, 1, 6) - AIC:-388.4099480064063

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 1, 6) - Test RMSE: 0.05041420526518064
ARIMA(1, 2, 0) - AIC:-382.8776751931645

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 0) - Test RMSE: 0.030075668563302196
ARIMA(1, 2, 1) - AIC:-380.87007247939215

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 1) - Test RMSE: 0.030004443383415666
ARIMA(1, 2, 2) - AIC:-375.7907461572404

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 2) - Test RMSE: 0.04529816518175966
ARIMA(1, 2, 3) - AIC:-377.41886357440137

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 3) - Test RMSE: 0.029695505958044835
ARIMA(1, 2, 4) - AIC:-383.63415198973996

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 4) - Test RMSE: 0.04120134831239242
ARIMA(1, 2, 5) - AIC:-385.0860947023966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 5) - Test RMSE: 0.04095503469090788
ARIMA(1, 2, 6) - AIC:-382.50216905749863

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(1, 2, 6) - Test RMSE: 0.04250222107552389
ARIMA(2, 0, 0) - AIC:-373.16946963052357

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 0) - Test RMSE: 0.08784516737856549
ARIMA(2, 0, 1) - AIC:-376.1986841777029

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 1) - Test RMSE: 0.09397302419826165
ARIMA(2, 0, 2) - AIC:-282.4086129935133

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 2) - Test RMSE: 0.11348935993478085
ARIMA(2, 0, 3) - AIC:-311.3186709873355

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 3) - Test RMSE: 0.07042407499986683
ARIMA(2, 0, 4) - AIC:-328.1302481051966

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 4) - Test RMSE: 0.07421664358695579
ARIMA(2, 0, 5) - AIC:-331.6524564508811

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 5) - Test RMSE: 0.06679444250949447
ARIMA(2, 0, 6) - AIC:-292.10284992382935

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 0, 6) - Test RMSE: 0.34245584847869404
ARIMA(2, 1, 0) - AIC:-384.368303927542

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 0) - Test RMSE: 0.0300182371214265
ARIMA(2, 1, 1) - AIC:-382.1998843707397

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 1) - Test RMSE: 0.030878562382686502
ARIMA(2, 1, 2) - AIC:-380.8129483990026

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 2) - Test RMSE: 0.03028759834008332
ARIMA(2, 1, 3) - AIC:-378.72694645280524

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 3) - Test RMSE: 0.030888671095635985
ARIMA(2, 1, 4) - AIC:-377.06711037555243

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 4) - Test RMSE: 0.02931363955366861
ARIMA(2, 1, 5) - AIC:-384.2577072621762

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 5) - Test RMSE: 0.047553882187501874
ARIMA(2, 1, 6) - AIC:-386.6125135638169

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 1, 6) - Test RMSE: 0.04723028801801355
ARIMA(2, 2, 0) - AIC:-380.8901883396523

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 0) - Test RMSE: 0.0299905486947701
ARIMA(2, 2, 1) - AIC:-378.89418192149424

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 1) - Test RMSE: 0.02995423700309308
ARIMA(2, 2, 2) - AIC:-376.90090791610766

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 2) - Test RMSE: 0.029802348962896113
ARIMA(2, 2, 3) - AIC:-378.4137824836483

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 3) - Test RMSE: 0.028870934969235946
ARIMA(2, 2, 4) - AIC:-381.2931815248008

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 4) - Test RMSE: 0.030979999634604606
ARIMA(2, 2, 5) - AIC:-383.15434495370494

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 5) - Test RMSE: 0.03702201158236212
ARIMA(2, 2, 6) - AIC:-382.9672222960308

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

ARIMA(2, 2, 6) - Test RMSE: 0.0462943717318562
ARIMA(1, 1, 5) with lowest AIC of -388.7020424979628
ARIMA(2, 2, 3) with lowest test RMSE of 0.028870934969235946
                                  SARIMAX Results                                   
====================================================================================
Dep. Variable:     Additional_Doses_Vax_Pct   No. Observations:                   56
Model:                       ARIMA(1, 1, 5)   Log Likelihood                 201.351
Date:                      Mon, 27 Nov 2023   AIC                           -388.702
Time:                              18:47:18   BIC                           -374.651
Sample:                          11-03-2021   HQIC                          -383.268
                               - 11-23-2022                                         
Covariance Type:                        opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.9451      0.022     42.845      0.000       0.902       0.988
ma.L1         -0.3162      0.200     -1.584      0.113      -0.707       0.075
ma.L2          0.1448      0.158      0.915      0.360      -0.165       0.455
ma.L3         -0.0399      0.198     -0.201      0.840      -0.428       0.348
ma.L4          0.2786      0.242      1.153      0.249      -0.195       0.752
ma.L5          0.3989      0.215      1.854      0.064      -0.023       0.821
sigma2      3.529e-05   1.27e-05      2.787      0.005    1.05e-05    6.01e-05
===================================================================================
Ljung-Box (L1) (Q):                   1.41   Jarque-Bera (JB):                20.36
Prob(Q):                              0.24   Prob(JB):                         0.00
Heteroskedasticity (H):               0.06   Skew:                             0.79
Prob(H) (two-sided):                  0.00   Kurtosis:                         5.53
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
Best ARIMA(2, 2, 3) - Train RMSE: 0.011363769653325214
Best ARIMA(2, 2, 3) - Test RMSE: 0.028870934969235946

Code

# Fit the ARIMA model223 with (2, 2, 3) parameters on the training data
model223 = ARIMA(train_ars, order=(2, 2, 3))
fitted_model223 = model223.fit()

# Predict on the train set
train_pred_scaled = fitted_model223.predict(start=train_ars.index[0], end=train_ars.index[-1], dynamic=False)

# Inverse transform the train predictions and actual values
train_pred = scaler.inverse_transform(train_pred_scaled.values.reshape(-1, 1)).flatten()
train_actual = scaler.inverse_transform(train_ars.values.reshape(-1, 1)).flatten()

# Predict on the test set
test_pred_scaled = fitted_model223.predict(start=test_ars.index[0], end=test_ars.index[-1], dynamic=False)

# Inverse transform the test predictions and actual values
test_pred = scaler.inverse_transform(test_pred_scaled.values.reshape(-1, 1)).flatten()
test_actual = scaler.inverse_transform(test_ars.values.reshape(-1, 1)).flatten()

# Calculate the RMSE for both train and test sets
train_rmse = np.sqrt(mean_squared_error(train_actual, train_pred))
test_rmse = np.sqrt(mean_squared_error(test_actual, test_pred))

# Print the RMSE values
print(f'Train RMSE: {train_rmse}')
print(f'Test RMSE: {test_rmse}')

Train RMSE: 0.46300258981266973
Test RMSE: 1.4118959165705978

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

1.8.2 auto_arima

#### Other models

Code

# Possible m values
seasonal_periods = [13, 12, 24]  

# Store results
results = []

for m in seasonal_periods:
    # Fit auto_arima model
    model = auto_arima(train_aar, start_p=0, start_q=0,
                   max_p=7, max_q=7, m=m,
                   start_P=0, seasonal=True,
                   d=None, D=None, trace=True,
                   error_action='warn',  
                   suppress_warnings=False, 
                   stepwise=True)

    # Make predictions
    train_predictions = model.predict_in_sample()
    test_predictions = model.predict(n_periods=len(test_aar))

    # Calculate RMSE
    train_rmse = np.sqrt(mean_squared_error(train_aar, train_predictions))
    test_rmse = np.sqrt(mean_squared_error(test_aar, test_predictions))

    # Store results
    results.append({
        'm': m,
        'train_rmse': train_rmse,
        'test_rmse': test_rmse
    })

    print(f"Completed auto_arima for m={m}")

# Compare the models based on RMSE
for result in results:
    print(f"m={result['m']}: Train RMSE={result['train_rmse']}, Test RMSE={result['test_rmse']}")

Performing stepwise search to minimize aic

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,0)(0,0,1)[13]             : AIC=-380.517, Time=0.28 sec
 ARIMA(0,2,0)(0,0,0)[13]             : AIC=-381.443, Time=0.02 sec
 ARIMA(1,2,0)(1,0,0)[13]             : AIC=-381.273, Time=0.07 sec
 ARIMA(0,2,1)(0,0,1)[13]             : AIC=-381.162, Time=0.06 sec
 ARIMA(0,2,0)(1,0,0)[13]             : AIC=-380.183, Time=0.04 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,0)(1,0,1)[13]             : AIC=-378.436, Time=0.14 sec
 ARIMA(1,2,0)(0,0,0)[13]             : AIC=-382.878, Time=0.02 sec
 ARIMA(1,2,0)(0,0,1)[13]             : AIC=-381.222, Time=0.02 sec
 ARIMA(1,2,0)(1,0,1)[13]             : AIC=-379.028, Time=0.03 sec
 ARIMA(2,2,0)(0,0,0)[13]             : AIC=-380.890, Time=0.02 sec
 ARIMA(1,2,1)(0,0,0)[13]             : AIC=-380.870, Time=0.02 sec
 ARIMA(0,2,1)(0,0,0)[13]             : AIC=-382.831, Time=0.01 sec
 ARIMA(2,2,1)(0,0,0)[13]             : AIC=-378.894, Time=0.08 sec
 ARIMA(1,2,0)(0,0,0)[13] intercept   : AIC=-383.736, Time=0.02 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(1,0,0)[13] intercept   : AIC=-382.384, Time=0.07 sec
 ARIMA(1,2,0)(0,0,1)[13] intercept   : AIC=-382.273, Time=0.03 sec
 ARIMA(1,2,0)(1,0,1)[13] intercept   : AIC=-380.626, Time=0.12 sec
 ARIMA(0,2,0)(0,0,0)[13] intercept   : AIC=-381.121, Time=0.01 sec
 ARIMA(2,2,0)(0,0,0)[13] intercept   : AIC=-382.006, Time=0.03 sec
 ARIMA(1,2,1)(0,0,0)[13] intercept   : AIC=-382.157, Time=0.01 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(0,0,0)[13] intercept   : AIC=-384.189, Time=0.04 sec
 ARIMA(0,2,1)(1,0,0)[13] intercept   : AIC=-382.840, Time=0.09 sec
 ARIMA(0,2,1)(0,0,1)[13] intercept   : AIC=-382.728, Time=0.06 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(1,0,1)[13] intercept   : AIC=-381.110, Time=0.25 sec
 ARIMA(0,2,2)(0,0,0)[13] intercept   : AIC=-382.206, Time=0.09 sec
 ARIMA(1,2,2)(0,0,0)[13] intercept   : AIC=-372.919, Time=0.02 sec

Best model:  ARIMA(0,2,1)(0,0,0)[13] intercept
Total fit time: 1.679 seconds
Completed auto_arima for m=13
Performing stepwise search to minimize aic
 ARIMA(0,2,0)(0,0,1)[12]             : AIC=-382.010, Time=0.03 sec
 ARIMA(0,2,0)(0,0,0)[12]             : AIC=-381.443, Time=0.01 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(1,0,0)[12]             : AIC=-383.598, Time=0.06 sec
 ARIMA(0,2,1)(0,0,1)[12]             : AIC=-383.356, Time=0.09 sec
 ARIMA(1,2,0)(0,0,0)[12]             : AIC=-382.878, Time=0.02 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(2,0,0)[12]             : AIC=-381.586, Time=0.27 sec
 ARIMA(1,2,0)(1,0,1)[12]             : AIC=-381.600, Time=0.18 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(0,0,1)[12]             : AIC=-383.420, Time=0.10 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(2,0,1)[12]             : AIC=-379.601, Time=0.38 sec
 ARIMA(0,2,0)(1,0,0)[12]             : AIC=-381.499, Time=0.09 sec
 ARIMA(2,2,0)(1,0,0)[12]             : AIC=-381.603, Time=0.08 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,1)(1,0,0)[12]             : AIC=-381.582, Time=0.15 sec
 ARIMA(0,2,1)(1,0,0)[12]             : AIC=-382.856, Time=0.06 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(2,2,1)(1,0,0)[12]             : AIC=-379.238, Time=0.22 sec
 ARIMA(1,2,0)(1,0,0)[12] intercept   : AIC=-383.708, Time=0.15 sec
 ARIMA(1,2,0)(0,0,0)[12] intercept   : AIC=-383.736, Time=0.02 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(0,0,1)[12] intercept   : AIC=-383.693, Time=0.08 sec
 ARIMA(1,2,0)(1,0,1)[12] intercept   : AIC=-381.726, Time=0.09 sec
 ARIMA(0,2,0)(0,0,0)[12] intercept   : AIC=-381.121, Time=0.02 sec
 ARIMA(2,2,0)(0,0,0)[12] intercept   : AIC=-382.006, Time=0.02 sec
 ARIMA(1,2,1)(0,0,0)[12] intercept   : AIC=-382.157, Time=0.02 sec
 ARIMA(0,2,1)(0,0,0)[12] intercept   : AIC=-384.189, Time=0.02 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(1,0,0)[12] intercept   : AIC=-383.968, Time=0.19 sec
 ARIMA(0,2,1)(0,0,1)[12] intercept   : AIC=-384.038, Time=0.13 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(1,0,1)[12] intercept   : AIC=-382.006, Time=0.14 sec
 ARIMA(0,2,2)(0,0,0)[12] intercept   : AIC=-382.206, Time=0.09 sec
 ARIMA(1,2,2)(0,0,0)[12] intercept   : AIC=-372.919, Time=0.02 sec
 ARIMA(0,2,1)(0,0,0)[12]             : AIC=-382.831, Time=0.01 sec

Best model:  ARIMA(0,2,1)(0,0,0)[12] intercept
Total fit time: 2.755 seconds
Completed auto_arima for m=12
Performing stepwise search to minimize aic

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,0)(0,0,1)[24]             : AIC=-379.444, Time=0.20 sec
 ARIMA(0,2,0)(0,0,0)[24]             : AIC=-381.443, Time=0.02 sec
 ARIMA(1,2,0)(1,0,0)[24]             : AIC=-380.937, Time=0.05 sec
 ARIMA(0,2,1)(0,0,1)[24]             : AIC=-380.831, Time=0.08 sec
 ARIMA(0,2,0)(1,0,0)[24]             : AIC=-379.475, Time=0.04 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,0)(1,0,1)[24]             : AIC=-377.444, Time=0.17 sec
 ARIMA(1,2,0)(0,0,0)[24]             : AIC=-382.878, Time=0.02 sec
 ARIMA(1,2,0)(0,0,1)[24]             : AIC=-380.878, Time=0.04 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(1,0,1)[24]             : AIC=-378.878, Time=0.24 sec
 ARIMA(2,2,0)(0,0,0)[24]             : AIC=-380.890, Time=0.02 sec
 ARIMA(1,2,1)(0,0,0)[24]             : AIC=-380.870, Time=0.03 sec
 ARIMA(0,2,1)(0,0,0)[24]             : AIC=-382.831, Time=0.01 sec
 ARIMA(2,2,1)(0,0,0)[24]             : AIC=-378.894, Time=0.03 sec
 ARIMA(1,2,0)(0,0,0)[24] intercept   : AIC=-383.736, Time=0.02 sec
 ARIMA(1,2,0)(1,0,0)[24] intercept   : AIC=-381.738, Time=0.07 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(0,0,1)[24] intercept   : AIC=-381.740, Time=0.15 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(1,2,0)(1,0,1)[24] intercept   : AIC=-379.736, Time=0.32 sec
 ARIMA(0,2,0)(0,0,0)[24] intercept   : AIC=-381.121, Time=0.02 sec
 ARIMA(2,2,0)(0,0,0)[24] intercept   : AIC=-382.006, Time=0.03 sec
 ARIMA(1,2,1)(0,0,0)[24] intercept   : AIC=-382.157, Time=0.02 sec
 ARIMA(0,2,1)(0,0,0)[24] intercept   : AIC=-384.189, Time=0.02 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(1,0,0)[24] intercept   : AIC=-382.239, Time=0.46 sec
 ARIMA(0,2,1)(0,0,1)[24] intercept   : AIC=-382.254, Time=0.13 sec

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

 ARIMA(0,2,1)(1,0,1)[24] intercept   : AIC=-380.254, Time=0.23 sec
 ARIMA(0,2,2)(0,0,0)[24] intercept   : AIC=-382.206, Time=0.10 sec
 ARIMA(1,2,2)(0,0,0)[24] intercept   : AIC=-372.919, Time=0.02 sec

Best model:  ARIMA(0,2,1)(0,0,0)[24] intercept
Total fit time: 2.560 seconds
Completed auto_arima for m=24
m=13: Train RMSE=0.011543544562959192, Test RMSE=0.14297127345218566
m=12: Train RMSE=0.011543544562959192, Test RMSE=0.14297127345218566
m=24: Train RMSE=0.011543544562959192, Test RMSE=0.14297127345218566

/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)
/Users/avaserin/anaconda3/lib/python3.11/site-packages/statsmodels/tsa/base/tsa_model.py:473: ValueWarning: No frequency information was provided, so inferred frequency W-WED will be used.
  self._init_dates(dates, freq)

Code

# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=13,
                        start_P=0, seasonal=True,
                        d=1, D=1, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")

 ARIMA(0,1,0)(0,1,0)[13]             : AIC=-183.904, Time=0.03 sec
 ARIMA(0,1,0)(0,1,1)[13]             : AIC=-182.567, Time=0.07 sec
 ARIMA(0,1,0)(0,1,2)[13]             : AIC=-180.910, Time=0.41 sec
 ARIMA(0,1,0)(1,1,0)[13]             : AIC=-182.784, Time=0.21 sec
 ARIMA(0,1,0)(1,1,1)[13]             : AIC=-180.663, Time=0.11 sec
 ARIMA(0,1,0)(1,1,2)[13]             : AIC=-178.891, Time=0.54 sec
 ARIMA(0,1,0)(2,1,0)[13]             : AIC=-180.888, Time=0.55 sec
 ARIMA(0,1,0)(2,1,1)[13]             : AIC=-178.880, Time=0.66 sec
 ARIMA(0,1,0)(2,1,2)[13]             : AIC=-176.904, Time=0.62 sec
 ARIMA(0,1,1)(0,1,0)[13]             : AIC=-213.586, Time=0.07 sec
 ARIMA(0,1,1)(0,1,1)[13]             : AIC=-211.729, Time=0.68 sec
 ARIMA(0,1,1)(0,1,2)[13]             : AIC=-209.742, Time=0.91 sec
 ARIMA(0,1,1)(1,1,0)[13]             : AIC=-211.696, Time=0.17 sec
 ARIMA(0,1,1)(1,1,1)[13]             : AIC=-209.728, Time=0.49 sec
 ARIMA(0,1,1)(1,1,2)[13]             : AIC=-207.737, Time=2.31 sec
 ARIMA(0,1,1)(2,1,0)[13]             : AIC=-209.315, Time=1.43 sec
 ARIMA(0,1,1)(2,1,1)[13]             : AIC=-207.705, Time=1.08 sec
 ARIMA(0,1,1)(2,1,2)[13]             : AIC=-205.657, Time=0.97 sec
 ARIMA(0,1,2)(0,1,0)[13]             : AIC=-230.942, Time=0.06 sec
 ARIMA(0,1,2)(0,1,1)[13]             : AIC=-230.332, Time=0.37 sec
 ARIMA(0,1,2)(0,1,2)[13]             : AIC=-229.554, Time=1.82 sec
 ARIMA(0,1,2)(1,1,0)[13]             : AIC=-232.807, Time=0.36 sec
 ARIMA(0,1,2)(1,1,1)[13]             : AIC=-228.885, Time=0.98 sec
 ARIMA(0,1,2)(1,1,2)[13]             : AIC=-227.668, Time=1.28 sec
 ARIMA(0,1,2)(2,1,0)[13]             : AIC=-229.948, Time=0.90 sec
 ARIMA(0,1,2)(2,1,1)[13]             : AIC=-227.782, Time=1.52 sec
 ARIMA(0,1,3)(0,1,0)[13]             : AIC=-242.170, Time=0.13 sec
 ARIMA(0,1,3)(0,1,1)[13]             : AIC=-239.344, Time=0.97 sec
 ARIMA(0,1,3)(0,1,2)[13]             : AIC=-239.159, Time=1.47 sec
 ARIMA(0,1,3)(1,1,0)[13]             : AIC=-242.158, Time=0.60 sec
 ARIMA(0,1,3)(1,1,1)[13]             : AIC=-238.350, Time=0.88 sec
 ARIMA(0,1,3)(2,1,0)[13]             : AIC=-239.881, Time=2.44 sec
 ARIMA(0,1,4)(0,1,0)[13]             : AIC=-242.770, Time=0.31 sec
 ARIMA(0,1,4)(0,1,1)[13]             : AIC=-241.692, Time=0.72 sec
 ARIMA(0,1,4)(1,1,0)[13]             : AIC=-240.083, Time=0.55 sec
 ARIMA(0,1,5)(0,1,0)[13]             : AIC=-247.050, Time=0.24 sec
 ARIMA(1,1,0)(0,1,0)[13]             : AIC=-263.639, Time=0.03 sec
 ARIMA(1,1,0)(0,1,1)[13]             : AIC=-261.640, Time=0.05 sec
 ARIMA(1,1,0)(0,1,2)[13]             : AIC=-260.317, Time=0.64 sec
 ARIMA(1,1,0)(1,1,0)[13]             : AIC=-266.119, Time=0.55 sec
 ARIMA(1,1,0)(1,1,1)[13]             : AIC=-264.688, Time=0.39 sec
 ARIMA(1,1,0)(1,1,2)[13]             : AIC=-261.848, Time=1.16 sec
 ARIMA(1,1,0)(2,1,0)[13]             : AIC=-259.329, Time=0.77 sec
 ARIMA(1,1,0)(2,1,1)[13]             : AIC=-262.609, Time=0.98 sec
 ARIMA(1,1,0)(2,1,2)[13]             : AIC=-259.395, Time=1.42 sec
 ARIMA(1,1,1)(0,1,0)[13]             : AIC=-265.102, Time=0.10 sec
 ARIMA(1,1,1)(0,1,1)[13]             : AIC=-263.815, Time=0.49 sec
 ARIMA(1,1,1)(0,1,2)[13]             : AIC=-263.371, Time=1.34 sec
 ARIMA(1,1,1)(1,1,0)[13]             : AIC=-263.833, Time=0.31 sec
 ARIMA(1,1,1)(1,1,1)[13]             : AIC=-263.814, Time=1.07 sec
 ARIMA(1,1,1)(1,1,2)[13]             : AIC=-259.658, Time=0.40 sec
 ARIMA(1,1,1)(2,1,0)[13]             : AIC=-262.658, Time=1.34 sec
 ARIMA(1,1,1)(2,1,1)[13]             : AIC=-261.988, Time=1.89 sec
 ARIMA(1,1,2)(0,1,0)[13]             : AIC=-260.259, Time=0.11 sec
 ARIMA(1,1,2)(0,1,1)[13]             : AIC=-262.028, Time=1.92 sec
 ARIMA(1,1,2)(0,1,2)[13]             : AIC=-257.006, Time=1.71 sec
 ARIMA(1,1,2)(1,1,0)[13]             : AIC=-262.380, Time=0.24 sec
 ARIMA(1,1,2)(1,1,1)[13]             : AIC=-259.405, Time=0.60 sec
 ARIMA(1,1,2)(2,1,0)[13]             : AIC=-255.919, Time=3.36 sec
 ARIMA(1,1,3)(0,1,0)[13]             : AIC=-261.638, Time=0.26 sec
 ARIMA(1,1,3)(0,1,1)[13]             : AIC=-259.895, Time=2.60 sec
 ARIMA(1,1,3)(1,1,0)[13]             : AIC=-260.788, Time=2.40 sec
 ARIMA(1,1,4)(0,1,0)[13]             : AIC=-260.618, Time=0.28 sec
 ARIMA(2,1,0)(0,1,0)[13]             : AIC=-267.363, Time=0.07 sec
 ARIMA(2,1,0)(0,1,1)[13]             : AIC=-262.748, Time=0.06 sec
 ARIMA(2,1,0)(0,1,2)[13]             : AIC=-266.212, Time=0.83 sec
 ARIMA(2,1,0)(1,1,0)[13]             : AIC=-265.965, Time=0.40 sec
 ARIMA(2,1,0)(1,1,1)[13]             : AIC=-264.283, Time=0.44 sec
 ARIMA(2,1,0)(1,1,2)[13]             : AIC=-265.362, Time=1.52 sec
 ARIMA(2,1,0)(2,1,0)[13]             : AIC=-265.184, Time=0.82 sec
 ARIMA(2,1,0)(2,1,1)[13]             : AIC=-262.839, Time=1.08 sec
 ARIMA(2,1,1)(0,1,0)[13]             : AIC=-264.604, Time=0.14 sec
 ARIMA(2,1,1)(0,1,1)[13]             : AIC=-262.780, Time=0.17 sec
 ARIMA(2,1,1)(0,1,2)[13]             : AIC=-264.873, Time=1.46 sec
 ARIMA(2,1,1)(1,1,0)[13]             : AIC=-267.273, Time=0.38 sec
 ARIMA(2,1,1)(1,1,1)[13]             : AIC=-265.330, Time=0.37 sec
 ARIMA(2,1,1)(2,1,0)[13]             : AIC=-262.619, Time=0.91 sec
 ARIMA(2,1,2)(0,1,0)[13]             : AIC=-263.742, Time=0.13 sec
 ARIMA(2,1,2)(0,1,1)[13]             : AIC=-262.740, Time=0.80 sec
 ARIMA(2,1,2)(1,1,0)[13]             : AIC=-258.638, Time=0.56 sec
 ARIMA(2,1,3)(0,1,0)[13]             : AIC=-263.878, Time=0.24 sec
 ARIMA(3,1,0)(0,1,0)[13]             : AIC=-265.797, Time=0.11 sec
 ARIMA(3,1,0)(0,1,1)[13]             : AIC=-265.085, Time=0.39 sec
 ARIMA(3,1,0)(0,1,2)[13]             : AIC=-264.119, Time=1.14 sec
 ARIMA(3,1,0)(1,1,0)[13]             : AIC=-265.980, Time=0.62 sec
 ARIMA(3,1,0)(1,1,1)[13]             : AIC=-265.037, Time=0.82 sec
 ARIMA(3,1,0)(2,1,0)[13]             : AIC=-264.365, Time=1.17 sec
 ARIMA(3,1,1)(0,1,0)[13]             : AIC=-264.107, Time=0.14 sec
 ARIMA(3,1,1)(0,1,1)[13]             : AIC=-263.776, Time=0.56 sec
 ARIMA(3,1,1)(1,1,0)[13]             : AIC=-263.432, Time=0.34 sec
 ARIMA(3,1,2)(0,1,0)[13]             : AIC=-260.692, Time=0.26 sec
 ARIMA(4,1,0)(0,1,0)[13]             : AIC=-264.168, Time=0.12 sec
 ARIMA(4,1,0)(0,1,1)[13]             : AIC=-265.243, Time=0.56 sec
 ARIMA(4,1,0)(1,1,0)[13]             : AIC=-265.007, Time=0.77 sec
 ARIMA(4,1,1)(0,1,0)[13]             : AIC=-262.658, Time=0.22 sec
 ARIMA(5,1,0)(0,1,0)[13]             : AIC=-260.811, Time=0.09 sec

Best model:  ARIMA(2,1,0)(0,1,0)[13]          
Total fit time: 71.047 seconds
                                     SARIMAX Results                                      
==========================================================================================
Dep. Variable:                                  y   No. Observations:                   56
Model:             SARIMAX(2, 1, 0)x(0, 1, 0, 13)   Log Likelihood                 136.681
Date:                            Mon, 27 Nov 2023   AIC                           -267.363
Time:                                    21:11:29   BIC                           -262.150
Sample:                                11-03-2021   HQIC                          -265.452
                                     - 11-23-2022                                         
Covariance Type:                              opg                                         
==============================================================================
                 coef    std err          z      P>|z|      [0.025      0.975]
------------------------------------------------------------------------------
ar.L1          0.5922      0.110      5.363      0.000       0.376       0.809
ar.L2          0.3353      0.112      3.007      0.003       0.117       0.554
sigma2      8.356e-05   1.94e-05      4.314      0.000    4.56e-05       0.000
===================================================================================
Ljung-Box (L1) (Q):                   0.17   Jarque-Bera (JB):                 0.63
Prob(Q):                              0.68   Prob(JB):                         0.73
Heteroskedasticity (H):               0.19   Skew:                            -0.28
Prob(H) (two-sided):                  0.00   Kurtosis:                         3.20
===================================================================================

Warnings:
[1] Covariance matrix calculated using the outer product of gradients (complex-step).
AIC: -267.36267306708515

Code

# Train results
train_pred = model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")

Code

# Run auto_arima to find optimal SARIMA model parameters
model = auto_arima(train_aar, start_p=0, start_q=0,
                        max_p=7, max_q=7, m=24,
                        start_P=0, seasonal=True,
                        d=2, D = 0, trace=True,
                        error_action='ignore',  
                        suppress_warnings=True, 
                        stepwise=False)

print(model.summary())
print(f"AIC: {model.aic()}")

Code

# Train results
train_pred = model.predict_in_sample()
pd.concat([train_aar, pd.Series(train_pred, index=train.index)], axis=1).plot(figsize=(20,8))
plt.legend(['train', 'train_pred'])

# Calculate and print the train RMSE
train_rmse = np.sqrt(mean_squared_error(train_aar, train_pred))
print(f"Train RMSE: {train_rmse}")

# Test results
test_pred = model.predict(n_periods=len(test_aar))
pd.concat([test_aar, pd.Series(test_pred)], axis=1).plot(figsize=(20,8))
plt.legend(['test', 'test_pred'])

# Calculate and print the test RMSE
test_rmse = np.sqrt(mean_squared_error(test_aar, test_pred))
print(f"Test RMSE: {test_rmse}")

1.8.3 LSTM

#### Feature Extraction

Below I attempt to use PCA to reduce dimensionality for my LSTM model. However, the corresponding model has a much higher RMSE compared to models without dimension reduction.

Code

# Apply PCA to the scaled data without specifying n_components
pca = PCA()
pca.fit(df_scaled)

# Calculate the cumulative explained variance
cumulative_variance = np.cumsum(pca.explained_variance_ratio_)

# Plot the cumulative explained variance
plt.figure(figsize=(10, 6))
plt.plot(cumulative_variance)
plt.xlabel('Number of Components')
plt.ylabel('Cumulative Explained Variance')
plt.title('Explained Variance by Components')
plt.grid(True)
plt.show()

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location'
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Additional time-series columns to account for 3-month pattern
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

# Forward fill missing values
df_encoded.fillna(method='ffill', inplace=True)
df_encoded.fillna(method='bfill', inplace=True)

# Initialize MinMaxScaler
min_max_scaler = MinMaxScaler(feature_range=(0, 1))

# Separate target variable
target_series = df_encoded[pred_var]

# Apply MinMaxScaler to df_encoded excluding target variable
df_features_scaled = pd.DataFrame(min_max_scaler.fit_transform(df_encoded.drop(pred_var, axis=1)),
                                  columns=df_encoded.drop(pred_var, axis=1).columns, 
                                  index=df_encoded.index)

# Define the number of components for PCA
n_components = 18

# Apply PCA to the scaled feature data
pca = PCA(n_components=n_components)
df_pca = pca.fit_transform(df_features_scaled)

# Convert the PCA output to a DataFrame
df_pca = pd.DataFrame(df_pca, index=df_features_scaled.index)

# Function to create sequences for LSTM
def make_series(features, target, sequence_length):
    series = []
    for location, group in features.groupby(level='Location'):
        # Retrieve the corresponding target values for each location
        target_group = target.xs(location, level='Location')
        
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i - sequence_length:i].values
            target_val = target_group.iloc[i - sequence_length]
            series.append((sequence, target_val))
    return series


# Set sequence length
sequence_length = 12

# Create sequences from the scaled PCA data
data_series = make_series(df_pca, target_series, sequence_length)

# Split into train and test sequences
test_size = 1080  # Size of test set
train_series = data_series[:-test_size]
test_series = data_series[-test_size:]

# Prepare data for LSTM
X_train = np.array([x[0] for x in train_series])  # Feature sequences
y_train = np.array([x[1] for x in train_series])  # Corresponding target values
X_test = np.array([x[0] for x in test_series])    # Feature sequences
y_test = np.array([x[1] for x in test_series])    # Corresponding target values

# Initialize TimeSeriesSplit
tscv = TimeSeriesSplit(n_splits=5)

Code

# Cross-Validation Loop
for train_index, val_index in tscv.split(X_train):
    X_train_fold, X_val_fold = X_train[train_index], X_train[val_index]
    y_train_fold, y_val_fold = y_train[train_index], y_train[val_index]

    # Define LSTM model
    inputs = Input(shape=(sequence_length, X_train_fold.shape[2]))
    lstm_out = LSTM(32, return_sequences=False)(inputs)
    lstm_out = Dropout(0.2)(lstm_out)
    outputs = Dense(1)(lstm_out)
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')

    # Fit the model on this fold
    model.fit(X_train_fold, y_train_fold, epochs=100, batch_size=32,
              validation_data=(X_val_fold, y_val_fold), shuffle=False)

# Final Model Training on Full Train Data
model_final = Model(inputs=inputs, outputs=outputs)
model_final.compile(optimizer='adam', loss='mae')
model_final.fit(X_train, y_train, epochs=100, batch_size=32, shuffle=False)

# Final Model Evaluation on Test Data
y_pred_test = model_final.predict(X_test)
test_rmse = sqrt(mean_squared_error(y_test, y_pred_test))
print(f"Test RMSE: {test_rmse}")

68/68 [==============================] - 1s 12ms/step - loss: 4.8453 - val_loss: 3.7010
Epoch 25/100
68/68 [==============================] - 1s 13ms/step - loss: 4.6976 - val_loss: 3.4138
Epoch 26/100
68/68 [==============================] - 1s 12ms/step - loss: 4.4393 - val_loss: 3.2844
Epoch 27/100
68/68 [==============================] - 1s 12ms/step - loss: 4.3309 - val_loss: 2.9263
Epoch 28/100
68/68 [==============================] - 1s 12ms/step - loss: 4.1556 - val_loss: 2.9857
Epoch 29/100
68/68 [==============================] - 1s 12ms/step - loss: 4.2372 - val_loss: 2.9885
Epoch 30/100
68/68 [==============================] - 1s 12ms/step - loss: 4.0847 - val_loss: 2.4251
Epoch 31/100
68/68 [==============================] - 1s 12ms/step - loss: 3.8122 - val_loss: 2.4491
Epoch 32/100
68/68 [==============================] - 1s 13ms/step - loss: 3.8742 - val_loss: 2.6154
Epoch 33/100
68/68 [==============================] - 1s 16ms/step - loss: 3.7867 - val_loss: 2.4860
Epoch 34/100
68/68 [==============================] - 1s 16ms/step - loss: 3.7030 - val_loss: 2.4982
Epoch 35/100
68/68 [==============================] - 1s 12ms/step - loss: 3.7587 - val_loss: 2.8331
Epoch 36/100
68/68 [==============================] - 1s 12ms/step - loss: 3.6342 - val_loss: 2.4667
Epoch 37/100
68/68 [==============================] - 1s 11ms/step - loss: 3.6651 - val_loss: 2.5862
Epoch 38/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5500 - val_loss: 2.4261
Epoch 39/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5727 - val_loss: 2.6655
Epoch 40/100
68/68 [==============================] - 1s 11ms/step - loss: 3.7005 - val_loss: 2.2716
Epoch 41/100
68/68 [==============================] - 1s 12ms/step - loss: 3.6480 - val_loss: 2.4858
Epoch 42/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5104 - val_loss: 2.7581
Epoch 43/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5732 - val_loss: 2.3902
Epoch 44/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5398 - val_loss: 2.1827
Epoch 45/100
68/68 [==============================] - 1s 17ms/step - loss: 3.6158 - val_loss: 2.0044
Epoch 46/100
68/68 [==============================] - 1s 17ms/step - loss: 3.6082 - val_loss: 2.0777
Epoch 47/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4461 - val_loss: 2.2385
Epoch 48/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5960 - val_loss: 2.0981
Epoch 49/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5315 - val_loss: 2.3408
Epoch 50/100
68/68 [==============================] - 1s 11ms/step - loss: 3.4611 - val_loss: 2.5463
Epoch 51/100
68/68 [==============================] - 1s 11ms/step - loss: 3.5037 - val_loss: 2.1192
Epoch 52/100
68/68 [==============================] - 1s 11ms/step - loss: 3.4990 - val_loss: 2.3237
Epoch 53/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4692 - val_loss: 2.1170
Epoch 54/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3467 - val_loss: 2.0941
Epoch 55/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4314 - val_loss: 2.1715
Epoch 56/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2547 - val_loss: 2.1993
Epoch 57/100
68/68 [==============================] - 1s 12ms/step - loss: 3.5063 - val_loss: 2.0224
Epoch 58/100
68/68 [==============================] - 1s 12ms/step - loss: 3.3851 - val_loss: 2.3489
Epoch 59/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2549 - val_loss: 2.2169
Epoch 60/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4230 - val_loss: 2.1499
Epoch 61/100
68/68 [==============================] - 1s 12ms/step - loss: 3.3569 - val_loss: 2.1151
Epoch 62/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3209 - val_loss: 1.7524
Epoch 63/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2705 - val_loss: 2.0736
Epoch 64/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2785 - val_loss: 1.8567
Epoch 65/100
68/68 [==============================] - 1s 12ms/step - loss: 3.4309 - val_loss: 2.0271
Epoch 66/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3349 - val_loss: 2.1910
Epoch 67/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3630 - val_loss: 2.1321
Epoch 68/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2718 - val_loss: 2.0899
Epoch 69/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3674 - val_loss: 2.0311
Epoch 70/100
68/68 [==============================] - 1s 15ms/step - loss: 3.3130 - val_loss: 2.1585
Epoch 71/100
68/68 [==============================] - 1s 15ms/step - loss: 3.3513 - val_loss: 2.0220
Epoch 72/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2311 - val_loss: 2.3323
Epoch 73/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3204 - val_loss: 2.1309
Epoch 74/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2647 - val_loss: 2.1125
Epoch 75/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3674 - val_loss: 1.9299
Epoch 76/100
68/68 [==============================] - 1s 11ms/step - loss: 3.3852 - val_loss: 1.7248
Epoch 77/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2987 - val_loss: 2.0475
Epoch 78/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2897 - val_loss: 1.9580
Epoch 79/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2749 - val_loss: 2.0681
Epoch 80/100
68/68 [==============================] - 1s 11ms/step - loss: 3.2719 - val_loss: 2.1533
Epoch 81/100
68/68 [==============================] - 1s 17ms/step - loss: 3.1759 - val_loss: 1.9394
Epoch 82/100
68/68 [==============================] - 1s 16ms/step - loss: 3.1978 - val_loss: 1.9696
Epoch 83/100
68/68 [==============================] - 1s 16ms/step - loss: 3.2335 - val_loss: 2.1528
Epoch 84/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1784 - val_loss: 1.9344
Epoch 85/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1972 - val_loss: 2.2742
Epoch 86/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1721 - val_loss: 2.1799
Epoch 87/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2170 - val_loss: 1.8111
Epoch 88/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2500 - val_loss: 2.0240
Epoch 89/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2055 - val_loss: 1.9300
Epoch 90/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1900 - val_loss: 1.7681
Epoch 91/100
68/68 [==============================] - 1s 12ms/step - loss: 3.1974 - val_loss: 1.8980
Epoch 92/100
68/68 [==============================] - 1s 12ms/step - loss: 3.2011 - val_loss: 1.7647
Epoch 93/100
68/68 [==============================] - 1s 13ms/step - loss: 3.2324 - val_loss: 1.9307
Epoch 94/100
68/68 [==============================] - 1s 15ms/step - loss: 3.1037 - val_loss: 2.0384
Epoch 95/100
68/68 [==============================] - 1s 13ms/step - loss: 3.1662 - val_loss: 1.9949
Epoch 96/100
68/68 [==============================] - 1s 14ms/step - loss: 3.3538 - val_loss: 2.5795
Epoch 97/100
68/68 [==============================] - 1s 14ms/step - loss: 3.2106 - val_loss: 1.8488
Epoch 98/100
68/68 [==============================] - 1s 14ms/step - loss: 3.1821 - val_loss: 2.0333
Epoch 99/100
68/68 [==============================] - 1s 14ms/step - loss: 3.1218 - val_loss: 1.8472
Epoch 100/100
68/68 [==============================] - 1s 14ms/step - loss: 3.2190 - val_loss: 1.6719
Epoch 1/100
85/85 [==============================] - 4s 23ms/step - loss: 39.9653 - val_loss: 37.1757
Epoch 2/100
85/85 [==============================] - 1s 12ms/step - loss: 31.3266 - val_loss: 31.2456
Epoch 3/100
85/85 [==============================] - 1s 11ms/step - loss: 27.5042 - val_loss: 28.1528
Epoch 4/100
85/85 [==============================] - 1s 12ms/step - loss: 24.7661 - val_loss: 25.5283
Epoch 5/100
85/85 [==============================] - 1s 11ms/step - loss: 22.4229 - val_loss: 22.9251
Epoch 6/100
85/85 [==============================] - 1s 11ms/step - loss: 20.0313 - val_loss: 20.5135
Epoch 7/100
85/85 [==============================] - 1s 12ms/step - loss: 17.9038 - val_loss: 18.0862
Epoch 8/100
85/85 [==============================] - 1s 12ms/step - loss: 15.3808 - val_loss: 15.8206
Epoch 9/100
85/85 [==============================] - 1s 12ms/step - loss: 13.4633 - val_loss: 14.1317
Epoch 10/100
85/85 [==============================] - 1s 13ms/step - loss: 11.7013 - val_loss: 11.8835
Epoch 11/100
85/85 [==============================] - 1s 16ms/step - loss: 10.1864 - val_loss: 9.8489
Epoch 12/100
85/85 [==============================] - 1s 13ms/step - loss: 8.7482 - val_loss: 8.5482
Epoch 13/100
85/85 [==============================] - 1s 12ms/step - loss: 7.6142 - val_loss: 7.3647
Epoch 14/100
85/85 [==============================] - 1s 11ms/step - loss: 6.7742 - val_loss: 6.4122
Epoch 15/100
85/85 [==============================] - 1s 12ms/step - loss: 6.1427 - val_loss: 5.8699
Epoch 16/100
85/85 [==============================] - 1s 14ms/step - loss: 5.6075 - val_loss: 5.0487
Epoch 17/100
85/85 [==============================] - 1s 12ms/step - loss: 5.2592 - val_loss: 4.6364
Epoch 18/100
85/85 [==============================] - 1s 12ms/step - loss: 5.1197 - val_loss: 4.4476
Epoch 19/100
85/85 [==============================] - 1s 13ms/step - loss: 4.6206 - val_loss: 4.1555
Epoch 20/100
85/85 [==============================] - 1s 11ms/step - loss: 4.4267 - val_loss: 3.7178
Epoch 21/100
85/85 [==============================] - 1s 11ms/step - loss: 4.3344 - val_loss: 3.6455
Epoch 22/100
85/85 [==============================] - 1s 10ms/step - loss: 4.2677 - val_loss: 3.2970
Epoch 23/100
85/85 [==============================] - 1s 10ms/step - loss: 3.9154 - val_loss: 3.7783
Epoch 24/100
85/85 [==============================] - 1s 10ms/step - loss: 3.9392 - val_loss: 2.8976
Epoch 25/100
85/85 [==============================] - 1s 11ms/step - loss: 3.9164 - val_loss: 3.1914
Epoch 26/100
85/85 [==============================] - 1s 11ms/step - loss: 3.7197 - val_loss: 2.7461
Epoch 27/100
85/85 [==============================] - 1s 12ms/step - loss: 3.7901 - val_loss: 2.9936
Epoch 28/100
85/85 [==============================] - 1s 11ms/step - loss: 3.7201 - val_loss: 2.4624
Epoch 29/100
85/85 [==============================] - 1s 11ms/step - loss: 3.6650 - val_loss: 2.4512
Epoch 30/100
85/85 [==============================] - 1s 11ms/step - loss: 3.6826 - val_loss: 2.1564
Epoch 31/100
85/85 [==============================] - 1s 14ms/step - loss: 3.5367 - val_loss: 2.5484
Epoch 32/100
85/85 [==============================] - 1s 15ms/step - loss: 3.7178 - val_loss: 2.1624
Epoch 33/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5225 - val_loss: 2.3259
Epoch 34/100
85/85 [==============================] - 1s 11ms/step - loss: 3.5961 - val_loss: 2.0665
Epoch 35/100
85/85 [==============================] - 1s 13ms/step - loss: 3.4534 - val_loss: 2.1941
Epoch 36/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5689 - val_loss: 1.9571
Epoch 37/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4737 - val_loss: 2.4024
Epoch 38/100
85/85 [==============================] - 1s 13ms/step - loss: 3.5436 - val_loss: 2.1821
Epoch 39/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4158 - val_loss: 2.3103
Epoch 40/100
85/85 [==============================] - 1s 13ms/step - loss: 3.3831 - val_loss: 2.1581
Epoch 41/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4485 - val_loss: 2.3076
Epoch 42/100
85/85 [==============================] - 1s 12ms/step - loss: 3.5233 - val_loss: 2.5438
Epoch 43/100
85/85 [==============================] - 1s 12ms/step - loss: 3.3254 - val_loss: 2.0694
Epoch 44/100
85/85 [==============================] - 1s 10ms/step - loss: 3.4505 - val_loss: 2.1277
Epoch 45/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4790 - val_loss: 1.9289
Epoch 46/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3112 - val_loss: 1.7008
Epoch 47/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3002 - val_loss: 2.0206
Epoch 48/100
85/85 [==============================] - 1s 10ms/step - loss: 3.3636 - val_loss: 2.5176
Epoch 49/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3763 - val_loss: 2.2845
Epoch 50/100
85/85 [==============================] - 1s 10ms/step - loss: 3.3508 - val_loss: 2.3657
Epoch 51/100
85/85 [==============================] - 1s 14ms/step - loss: 3.3118 - val_loss: 1.9270
Epoch 52/100
85/85 [==============================] - 1s 14ms/step - loss: 3.4400 - val_loss: 2.0921
Epoch 53/100
85/85 [==============================] - 1s 13ms/step - loss: 3.3082 - val_loss: 1.9090
Epoch 54/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2761 - val_loss: 1.9518
Epoch 55/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3200 - val_loss: 2.6154
Epoch 56/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3114 - val_loss: 2.6621
Epoch 57/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3139 - val_loss: 2.2558
Epoch 58/100
85/85 [==============================] - 1s 11ms/step - loss: 3.3307 - val_loss: 1.6483
Epoch 59/100
85/85 [==============================] - 1s 12ms/step - loss: 3.3020 - val_loss: 1.8364
Epoch 60/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1884 - val_loss: 2.1094
Epoch 61/100
85/85 [==============================] - 1s 11ms/step - loss: 3.4052 - val_loss: 2.4968
Epoch 62/100
85/85 [==============================] - 1s 17ms/step - loss: 3.2705 - val_loss: 2.3667
Epoch 63/100
85/85 [==============================] - 1s 14ms/step - loss: 3.1633 - val_loss: 1.8812
Epoch 64/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1679 - val_loss: 2.2619
Epoch 65/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2646 - val_loss: 2.1807
Epoch 66/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1943 - val_loss: 1.8956
Epoch 67/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2872 - val_loss: 1.7815
Epoch 68/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2038 - val_loss: 1.8326
Epoch 69/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2824 - val_loss: 1.7867
Epoch 70/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2236 - val_loss: 1.6547
Epoch 71/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2658 - val_loss: 2.1449
Epoch 72/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2782 - val_loss: 2.0975
Epoch 73/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2478 - val_loss: 2.2757
Epoch 74/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2416 - val_loss: 2.2916
Epoch 75/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2347 - val_loss: 2.0796
Epoch 76/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1576 - val_loss: 2.0963
Epoch 77/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1294 - val_loss: 2.4357
Epoch 78/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1657 - val_loss: 2.6226
Epoch 79/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1464 - val_loss: 2.4189
Epoch 80/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2119 - val_loss: 2.1782
Epoch 81/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2513 - val_loss: 2.5850
Epoch 82/100
85/85 [==============================] - 1s 11ms/step - loss: 3.2056 - val_loss: 1.7091
Epoch 83/100
85/85 [==============================] - 1s 14ms/step - loss: 3.1338 - val_loss: 1.8212
Epoch 84/100
85/85 [==============================] - 1s 15ms/step - loss: 3.1984 - val_loss: 1.8781
Epoch 85/100
85/85 [==============================] - 1s 12ms/step - loss: 3.1545 - val_loss: 2.0418
Epoch 86/100

85/85 [==============================] - 1s 10ms/step - loss: 3.1711 - val_loss: 2.2443
Epoch 87/100
85/85 [==============================] - 1s 10ms/step - loss: 3.1630 - val_loss: 2.1885
Epoch 88/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1326 - val_loss: 2.6047
Epoch 89/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0922 - val_loss: 2.1033
Epoch 90/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1721 - val_loss: 1.8741
Epoch 91/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0409 - val_loss: 1.4296
Epoch 92/100
85/85 [==============================] - 1s 10ms/step - loss: 3.2003 - val_loss: 1.9129
Epoch 93/100
85/85 [==============================] - 1s 12ms/step - loss: 3.1350 - val_loss: 1.5444
Epoch 94/100
85/85 [==============================] - 1s 15ms/step - loss: 3.1073 - val_loss: 2.0192
Epoch 95/100
85/85 [==============================] - 1s 13ms/step - loss: 3.0853 - val_loss: 1.7759
Epoch 96/100
85/85 [==============================] - 1s 11ms/step - loss: 3.0838 - val_loss: 1.9075
Epoch 97/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1072 - val_loss: 1.6052
Epoch 98/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1974 - val_loss: 2.1607
Epoch 99/100
85/85 [==============================] - 1s 10ms/step - loss: 3.0698 - val_loss: 2.3638
Epoch 100/100
85/85 [==============================] - 1s 11ms/step - loss: 3.1350 - val_loss: 2.0014
Epoch 1/100
102/102 [==============================] - 3s 10ms/step - loss: 3.2339
Epoch 2/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1324
Epoch 3/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1350
Epoch 4/100
102/102 [==============================] - 1s 10ms/step - loss: 3.1591
Epoch 5/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0928
Epoch 6/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0864
Epoch 7/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1256
Epoch 8/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1339
Epoch 9/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1692
Epoch 10/100
102/102 [==============================] - 1s 11ms/step - loss: 3.1387
Epoch 11/100
102/102 [==============================] - 1s 12ms/step - loss: 3.0884
Epoch 12/100
102/102 [==============================] - 1s 15ms/step - loss: 3.0873
Epoch 13/100
102/102 [==============================] - 2s 16ms/step - loss: 3.0242
Epoch 14/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0628
Epoch 15/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0870
Epoch 16/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0888
Epoch 17/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0626
Epoch 18/100
102/102 [==============================] - 1s 11ms/step - loss: 3.1335
Epoch 19/100
102/102 [==============================] - 1s 14ms/step - loss: 3.1593
Epoch 20/100
102/102 [==============================] - 2s 18ms/step - loss: 3.0605
Epoch 21/100
102/102 [==============================] - 1s 14ms/step - loss: 3.0381
Epoch 22/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0225
Epoch 23/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0244
Epoch 24/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0537
Epoch 25/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0828
Epoch 26/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0261
Epoch 27/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0043
Epoch 28/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0413
Epoch 29/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0881
Epoch 30/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9915
Epoch 31/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0446
Epoch 32/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9774
Epoch 33/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0876
Epoch 34/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9911
Epoch 35/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9925
Epoch 36/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9801
Epoch 37/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9957
Epoch 38/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9831
Epoch 39/100
102/102 [==============================] - 1s 12ms/step - loss: 2.9472
Epoch 40/100
102/102 [==============================] - 1s 13ms/step - loss: 3.0021
Epoch 41/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0575
Epoch 42/100
102/102 [==============================] - 1s 11ms/step - loss: 3.0051
Epoch 43/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9604
Epoch 44/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0253
Epoch 45/100
102/102 [==============================] - 1s 9ms/step - loss: 3.1109
Epoch 46/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9890
Epoch 47/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0181
Epoch 48/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9452
Epoch 49/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9696
Epoch 50/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9621
Epoch 51/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9468
Epoch 52/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0436
Epoch 53/100
102/102 [==============================] - 1s 10ms/step - loss: 3.0047
Epoch 54/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9342
Epoch 55/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0001
Epoch 56/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9862
Epoch 57/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9889
Epoch 58/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9449
Epoch 59/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9172
Epoch 60/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8701
Epoch 61/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9050
Epoch 62/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9039
Epoch 63/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9217
Epoch 64/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9867
Epoch 65/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9441
Epoch 66/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9076
Epoch 67/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9534
Epoch 68/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9176
Epoch 69/100
102/102 [==============================] - 1s 12ms/step - loss: 2.9052
Epoch 70/100
102/102 [==============================] - 1s 13ms/step - loss: 2.9467
Epoch 71/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9474
Epoch 72/100
102/102 [==============================] - 1s 9ms/step - loss: 3.0187
Epoch 73/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9208
Epoch 74/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9717
Epoch 75/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9329
Epoch 76/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9442
Epoch 77/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9080
Epoch 78/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9387
Epoch 79/100
102/102 [==============================] - 1s 11ms/step - loss: 2.9070
Epoch 80/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9168
Epoch 81/100

102/102 [==============================] - 1s 11ms/step - loss: 2.9478
Epoch 82/100
102/102 [==============================] - 1s 10ms/step - loss: 2.8649
Epoch 83/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8334
Epoch 84/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8383
Epoch 85/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9648
Epoch 86/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8721
Epoch 87/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8458
Epoch 88/100
102/102 [==============================] - 1s 9ms/step - loss: 2.9719
Epoch 89/100
102/102 [==============================] - 1s 12ms/step - loss: 2.8608
Epoch 90/100
102/102 [==============================] - 1s 13ms/step - loss: 2.8715
Epoch 91/100
102/102 [==============================] - 1s 10ms/step - loss: 2.9552
Epoch 92/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8690
Epoch 93/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8911
Epoch 94/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8564
Epoch 95/100
102/102 [==============================] - 1s 11ms/step - loss: 2.8717
Epoch 96/100
102/102 [==============================] - 1s 10ms/step - loss: 2.7675
Epoch 97/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8989
Epoch 98/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8444
Epoch 99/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8390
Epoch 100/100
102/102 [==============================] - 1s 9ms/step - loss: 2.8583
34/34 [==============================] - 0s 3ms/step
Test RMSE: 3.1903854804665612

#### Initial LSTM Models

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location' (will be used to group)
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)

# 9 month lag
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

def process(df, target_var):
    lag_features = [col for col in df.columns if 'lag' in col or 'rolling' in col]
    df = df[[target_var] + lag_features]
    return df.fillna(0)

def normalize(df, target_var):
    for col in df.columns:
        if col != target_var:
            df[col] = (df[col] - df[col].mean()) / df[col].std()
    return df

# Process and normalize data
df_processed = process(df_encoded, pred_var)
df_normalized = normalize(df_processed, pred_var)

def make_series(data, sequence_length):
    series = []
    # Group by Location to maintain the structure per state
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(len(group) - sequence_length):
            subdf = group.iloc[i:i + sequence_length]
            series.append((subdf.index[-1], subdf[pred_var].iloc[-1], subdf.drop(pred_var, axis=1).values))
    return series

# 12 to capture 3 month pattern
sequence_length = 12
series = make_series(df_normalized, sequence_length)

# Split into train and test sets
# 1080 because it represents around 20-30% of df and is a multiple of 12
train = series[:-1080]
test = series[-1080:]

# Keras model 
num_features = df_normalized.shape[1] - 1  # excluding the target variable

inputs = keras.layers.Input(shape=(sequence_length, num_features))
lstm_out = keras.layers.LSTM(32)(inputs)
outputs = keras.layers.Dense(1)(lstm_out)

model = keras.Model(inputs=inputs, outputs=outputs)
model.compile(optimizer=keras.optimizers.Adam(learning_rate=0.01), loss="mae")
model.summary()

# Prepare data for training
x_train = np.array([x[2].reshape(sequence_length, num_features) for x in train])
y_train = np.array([x[1] for x in train])

# Fit the model
history = model.fit(
    x=x_train,
    y=y_train,
    epochs=100,
    batch_size=32,
    shuffle=True
)

Code

# Reshape the input data for the model
x_test = np.array([x[2].reshape(sequence_length, num_features) for x in test])

# Generate predictions for training data
train_pred = model.predict(np.array([x[2] for x in train]))
train_pred = pd.DataFrame(train_pred, columns=['yhat'], index=[x[0] for x in train])

# Actual values for training data
train_gt = pd.DataFrame([x[1] for x in train], columns=['y'], index=[x[0] for x in train])

# Plot training predictions and actual values
pd.concat([train_gt, train_pred], axis=1).plot(figsize=(20,10))
plt.legend(['train_gt', 'train_pred'])
plt.title('Training Data: Actual vs Predicted')
plt.show()

# Generate predictions for test data
test_pred = model.predict(x_test)
test_pred = pd.DataFrame(test_pred, columns=['yhat'], index=[x[0] for x in test])

# Actual values for test data
test_gt = pd.DataFrame([x[1] for x in test], columns=['y'], index=[x[0] for x in test])

# Plot test predictions and actual values
pd.concat([test_gt, test_pred], axis=1).plot(figsize=(20,10))
plt.legend(['test_gt', 'test_pred'])
plt.title('Test Data: Actual vs Predicted')
plt.show()

Code

def mean_absolute_percentage_error(y_true, y_pred): 
    return np.mean(np.abs((y_true - y_pred) / y_true)) * 100
y_test = np.array([x[1] for x in test])
# Assuming y_train and y_test are your actual values and train_pred, test_pred are your model's predictions
y_train_pred = model.predict(x_train).flatten()
y_test_pred = model.predict(x_test).flatten()

# Training Metrics
train_mae = mean_absolute_error(y_train, y_train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, y_train_pred))
train_mape = mean_absolute_percentage_error(y_train, y_train_pred)
train_r2 = r2_score(y_train, y_train_pred)

# Test Metrics
test_mae = mean_absolute_error(y_test, y_test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, y_test_pred))
test_mape = mean_absolute_percentage_error(y_test, y_test_pred)
test_r2 = r2_score(y_test, y_test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, MAPE: {train_mape}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, MAPE: {test_mape}, R2: {test_r2}")

Code

# Import data
df = pd.read_csv('df_post_eda.csv')

# Convert 'Date' to datetime and sort by 'Date' and 'Location'
df['Date'] = pd.to_datetime(df['Date'])
df = df.sort_values(by=['Date', 'Location'])

# Identify categorical columns except 'Location' (will be used to group)
categorical_cols = df.select_dtypes(include=['object', 'category']).columns.tolist()
categorical_cols.remove('Location')

# One-hot encode these categorical columns
df_encoded = pd.get_dummies(df, columns=categorical_cols)

# 'Date' and 'Location' as indices
df_encoded.set_index(['Date', 'Location'], inplace=True)

# Predictive variable
pred_var = 'Additional_Doses_Vax_Pct'

# Additional time-series columns to account for 3-month pattern
# 3 month lag
df_encoded['Additional_Doses_Vax_Pct_3_m_lag'] = df_encoded[pred_var].shift(12)

# 9 month lag
df_encoded['Additional_Doses_Vax_Pct_9_m_lag'] = df_encoded[pred_var].shift(36)

# Rolling statistics
df_encoded['rolling_mean'] = df_encoded[pred_var].shift().rolling(window=12).mean()
df_encoded['rolling_std'] = df_encoded[pred_var].shift().rolling(window=12).std()

def process(df, target_var):
    lag_features = [col for col in df.columns if 'lag' in col or 'rolling' in col]
    df = df[[target_var] + lag_features]
    return df.fillna(0)

# Normalize features based on training data
def normalize(train, test):
    mean = train.mean()
    std = train.std()
    
    train_normalized = (train - mean) / std
    test_normalized = (test - mean) / std
    
    return train_normalized, test_normalized

# Split into train and test sets (before normalization to prevent leakage)
# 1080 because it represents around 20-30% of df and is a multiple of 12
test_size = 1080 
train_df = df_encoded.iloc[:-test_size]
test_df = df_encoded.iloc[-test_size:]

# Process train and test sets separately
train_processed = process(train_df, pred_var)
test_processed = process(test_df, pred_var)

# Normalize the processed data
train_normalized, test_normalized = normalize(train_processed, test_processed)

# Create sequences for LSTM
def make_series(data, sequence_length):
    series = []
    for location, group in data.groupby(level='Location'):
        group = group.reset_index(level='Location', drop=True)
        for i in range(sequence_length, len(group)):
            sequence = group[i-sequence_length:i]
            target = group.iloc[i][pred_var]
            series.append((sequence.index[0], target, sequence.drop(pred_var, axis=1).values))
    return series

# 12 to capture 3 month pattern
sequence_length = 12
# Create sequences for LSTM from the normalized data
train_series = make_series(train_normalized, sequence_length)
test_series = make_series(test_normalized, sequence_length)

# Prepare data for LSTM
x_train = np.array([x[2] for x in train_series])
y_train = np.array([x[1] for x in train_series])

x_test = np.array([x[2] for x in test_series])
y_test = np.array([x[1] for x in test_series])

# LSTM model with Dropout
inputs = Input(shape=(sequence_length, x_train.shape[2]))
lstm_out = LSTM(32, return_sequences=False)(inputs)
lstm_out = Dropout(0.2)(lstm_out)  # Add dropout
outputs = Dense(1)(lstm_out)

model = Model(inputs=inputs, outputs=outputs)
model.compile(optimizer='adam', loss='mae')

# Fit the model
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=32,
    validation_data=(x_test, y_test),  # Add validation data
    shuffle=False  # Do not shuffle time series data
)

Code

# Predictions
train_pred = model.predict(x_train).flatten()  # Flatten to ensure it's a 1D array
test_pred = model.predict(x_test).flatten()

# Create DataFrames for the actual and predicted values with proper indexing
# Ensure the index is constructed correctly for the training ground truth
train_indices = [x[0] for x in train_series]
train_gt = pd.DataFrame(y_train, columns=['y'], index=train_indices)
train_pred_df = pd.DataFrame(train_pred, columns=['yhat'], index=train_indices)

# Plot training predictions and actual values
pd.concat([train_gt, train_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Training Data: Actual vs Predicted')
# Ensure the index is constructed correctly for the test ground truth
test_indices = [x[0] for x in test_series]
test_gt = pd.DataFrame(y_test, columns=['y'], index=test_indices)
test_pred_df = pd.DataFrame(test_pred, columns=['yhat'], index=test_indices)

# Plot test predictions and actual values
pd.concat([test_gt, test_pred_df], axis=1).plot(figsize=(20,10))
plt.legend(['Actual', 'Predicted'])
plt.title('Test Data: Actual vs Predicted')
plt.show()

Code

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}")
print(f"RMSE: {train_rmse}")
print(f"R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}")
print(f"RMSE: {test_rmse}")
print(f"R2: {test_r2}")

Code

def build_model(sequence_length, num_features):
    inputs = Input(shape=(sequence_length, num_features))
    lstm_out = Bidirectional(LSTM(16, return_sequences=True, 
                                  kernel_regularizer=l1_l2(l1=0.01, l2=0.01)))(inputs)
    lstm_out = BatchNormalization()(lstm_out)
    lstm_out = Dropout(0.5)(lstm_out)
    lstm_out = LSTM(8, return_sequences=False,
                    kernel_regularizer=l1_l2(l1=0.01, l2=0.01))(lstm_out)
    lstm_out = BatchNormalization()(lstm_out)
    lstm_out = Dropout(0.5)(lstm_out)
    outputs = Dense(1)(lstm_out)
    
    model = Model(inputs=inputs, outputs=outputs)
    model.compile(optimizer='adam', loss='mae')
    return model

# Create the model
model = build_model(sequence_length, num_features)

# Early stopping to prevent overfitting
early_stopping = EarlyStopping(monitor='val_loss', patience=10, restore_best_weights=True)

# Fit the model with early stopping
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=64,
    validation_data=(x_test, y_test),
    shuffle=False,
    callbacks=[early_stopping]
)

# Predictions
train_pred = model.predict(x_train).flatten()
test_pred = model.predict(x_test).flatten()

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")

Code

# Define a Learning Rate Scheduler
def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1)

# Build the LSTM model with added complexity and regularization
def build_model(input_shape, output_units=1, neurons=64, dropout=0.3, regularization=(0.01, 0.01)):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(*regularization)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(*regularization)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units))
    
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=10)

# Model training
model = build_model(input_shape=(sequence_length, x_train.shape[2]))
history = model.fit(
    x_train, y_train,
    epochs=100,
    batch_size=64,
    validation_data=(x_test, y_test),
    shuffle=False,
    callbacks=[lr_schedule, early_stopping]
)

# Plot the training and validation loss
plt.plot(history.history['loss'], label='train')
plt.plot(history.history['val_loss'], label='test')
plt.legend()
plt.show()

# Generate predictions
train_pred = model.predict(x_train)
test_pred = model.predict(x_test)

# Calculate metrics
train_mae = mean_absolute_error(y_train, train_pred)
train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
train_r2 = r2_score(y_train, train_pred)

test_mae = mean_absolute_error(y_test, test_pred)
test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
test_r2 = r2_score(y_test, test_pred)

print("Training Metrics:")
print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

print("\nTest Metrics:")
print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")

Code

def scheduler(epoch, lr):
    if epoch < 10:
        return lr
    else:
        return lr * np.exp(-0.1 * (epoch // 10))  # More aggressive decay every 10 epochs

# Adjusting the regularization strengths and dropout rates
def build_model(input_shape, output_units=1, neurons=16, dropout=0.3, l1_reg=0.0001, l2_reg=0.0001):
    model = Sequential()
    model.add(LSTM(neurons, return_sequences=True, input_shape=input_shape,
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(LSTM(neurons, return_sequences=False, 
                   kernel_regularizer=l1_l2(l1=l1_reg, l2=l2_reg)))
    model.add(Dropout(dropout))
    model.add(Dense(output_units))
    
    model.compile(optimizer=Adam(learning_rate=0.001), loss='mae')
    return model

# Callbacks
lr_schedule = LearningRateScheduler(scheduler)
early_stopping = EarlyStopping(monitor='val_loss', patience=20, restore_best_weights=True)

# Assuming x_train, y_train, x_test, y_test, and sequence_length are already defined
input_shape = (sequence_length, x_train.shape[2])

# Experimenting with different batch sizes
batch_sizes = [32, 64, 128]

for batch_size in batch_sizes:
    model = build_model(input_shape)
    history = model.fit(
        x_train, y_train,
        epochs=100,
        batch_size=batch_size,
        validation_data=(x_test, y_test),
        shuffle=False,
        callbacks=[lr_schedule, early_stopping]
    )

    # Plot the training and validation loss
    plt.plot(history.history['loss'], label='train')
    plt.plot(history.history['val_loss'], label='test')
    plt.title(f'Batch Size: {batch_size}')
    plt.legend()
    plt.show()

    # Generate predictions
    train_pred = model.predict(x_train)
    test_pred = model.predict(x_test)

    # Calculate metrics
    train_mae = mean_absolute_error(y_train, train_pred)
    train_rmse = np.sqrt(mean_squared_error(y_train, train_pred))
    train_r2 = r2_score(y_train, train_pred)

    test_mae = mean_absolute_error(y_test, test_pred)
    test_rmse = np.sqrt(mean_squared_error(y_test, test_pred))
    test_r2 = r2_score(y_test, test_pred)

    print(f"Batch Size: {batch_size}")
    print("Training Metrics:")
    print(f"MAE: {train_mae}, RMSE: {train_rmse}, R2: {train_r2}")

    print("\nTest Metrics:")
    print(f"MAE: {test_mae}, RMSE: {test_rmse}, R2: {test_r2}")